Data Engineer (Azure Databricks) – 1-Year Contract

About the role

We are seeking a hands‑on Data Engineer to join our team on a 1‑year contract. You will work closely with our Lead Data Engineer and Analytics Engineers to build and maintain scalable cloud data pipelines using Azure Databricks, supporting BI initiatives in Power BI and Sigma.

Key responsibilities

• Design, develop, and deploy ETL/ELT pipelines on Azure Databricks, creating Bronze (raw) and Silver (cleaned) layers within a Medallion architecture.
• Implement automated data quality checks, testing frameworks, and ensure data accuracy and reliability.
• Monitor, troubleshoot, and optimise existing Databricks workflows, handling schema changes and performance tuning of PySpark and Spark SQL jobs.
• Collaborate with Analytics Engineers to deliver trusted datasets for downstream reporting and ad‑hoc business requests.

Required profile

• 2‑4 years of production‑grade data engineering experience.
• Strong hands‑on expertise with Azure Databricks, PySpark, and Spark SQL.
• Proven ability to build Bronze and Silver layers in a Medallion architecture.
• Advanced SQL skills, including complex transformations and performance optimisation.

Required skills

• Azure Databricks
• PySpark
• Spark SQL
• SQL
• Git and CI/CD practices
• Power BI or Sigma
• dbt (nice to have)
• Apache Airflow (nice to have)
• Azure ADLS Gen2, Amazon S3, Google Cloud Storage