Data Engineer – Production Data Lake (Databricks)

About the role

We are looking for a Data Engineer to support a production Data Lake environment built on Databricks. The platform is live and in active use, and you will keep it healthy, support ongoing transformations and reports, and act as the go‑to person for any issues.

Key responsibilities

• Support and maintain the production Data Lake, including transformations and reports hosted in Databricks.
• Monitor pipeline health and investigate and resolve data issues as they arise.
• Maintain and improve existing Python‑based transformation logic.
• Support end users and stakeholders with data‑related requests and incidents.
• Document changes and maintain up‑to‑date technical documentation for the platform.

Required profile

• 3–6 years of hands‑on experience with Databricks in a production environment.
• Strong Python skills – able to read, maintain, debug, and improve existing code.
• Experience supporting or maintaining data pipelines and transformation logic.
• Reliable, responsive, and comfortable owning a live system independently.
• General understanding of Azure and how it underpins cloud data platform deployments (preferred).
• Experience working in a support or maintenance capacity on an established data platform (preferred).

Required skills

• Databricks
• Python
• Azure