<p>We are seeking a skilled Data Engineer to design, build and maintain robust data pipelines, warehouses and platforms that enable reliable analytics and machine learning. The ideal candidate will collaborate with data scientists, analysts and engineers to ensure data is accurate, timely and accessible.</p>
<h2>Data Engineer Job Profile</h2>
<p>The Data Engineer will develop scalable data architectures, implement ETL processes and optimise data flows across cloud and on-premises systems. They will support data governance, performance tuning and enablement of self-service analytics.</p>
<p>This role requires strong programming skills, practical experience with big data technologies and a good understanding of data modelling and warehousing principles.</p>
<h2>Data Engineer Job Description</h2>
<p>As a Data Engineer, you will be responsible for translating business and analytical requirements into reliable data solutions. You will design, build and maintain data pipelines that ingest, transform and deliver high-quality data to analytical platforms and applications. You will work across cloud services, relational and non-relational databases, stream processing engines and orchestration tools to create resilient and testable systems.</p>
<p>The role involves close collaboration with data scientists to support model training and deployment, and with analysts to ensure data is discoverable and well-documented. You will proactively identify opportunities to optimise storage, improve query performance and reduce operational costs through automation and sound engineering practices.</p>
<p>Maintaining data quality is central to this position. You will establish monitoring, alerting and lineage to ensure data integrity and to troubleshoot incidents. You will also contribute to data security and compliance activities, ensuring sensitive information is handled according to policy and legal requirements.</p>
<h2>Data Engineer Duties and Responsibilities</h2>
<ul>
<li>Design, build and maintain ETL and ELT data pipelines for batch and real-time processing.</li>
<li>Develop and maintain data warehouses, data lakes and data marts to support analytics and reporting.</li>
<li>Implement data modelling, schema design and table partitioning for performance and scalability.</li>
<li>Collaborate with data scientists and analysts to productionise models and deliver analytical datasets.</li>
<li>Optimise SQL queries and distributed processing jobs to reduce cost and improve throughput.</li>
<li>Deploy and manage data infrastructure on cloud platforms such as AWS, GCP or Azure.</li>
<li>Automate data workflows with orchestration tools and establish robust testing and CI practices.</li>
<li>Monitor data pipelines, implement alerting and perform root cause analysis for issues.</li>
<li>Implement data governance, cataloguing and lineage to enhance data discoverability and trust.</li>
<li>Ensure data privacy and security controls are applied and maintained in line with policy.</li>
</ul>
<h2>Data Engineer Requirements and Qualifications</h2>
<ul>
<li>Bachelor's degree in Computer Science, Engineering, Mathematics or related field, or equivalent experience.</li>
<li>Proven experience as a Data Engineer, Big Data Engineer or similar role in a production environment.</li>
<li>Strong programming skills in Python, Java or Scala and experience with SQL.</li>
<li>Hands-on experience with data processing frameworks such as Apache Spark, Flink or Beam.</li>
<li>Experience with cloud data platforms and services on AWS, GCP or Azure, including managed warehouses and storage.</li>
<li>Familiarity with data modelling, OLAP, star schemas and ETL/ELT patterns.</li>
<li>Experience with orchestration tools such as Airflow, DBT or similar and version control systems.</li>
<li>Knowledge of streaming technologies such as Kafka, Pub/Sub or Kinesis is desirable.</li>
<li>Strong problem-solving skills, attention to detail and the ability to communicate technical concepts to non-technical stakeholders.</li>
<li>Experience with data governance, lineage tools and compliance frameworks is an advantage.</li>
</ul>