Lead Data Platform Engineer

General Description

Lead Data Platform Engineer

Ready to make your application Please do read through the description at least once before clicking on Apply.

UK Remote

Salary: £80,000 – £85,000

This is an opportunity to step into a highly influential Data Platform Engineering role where you will shape, optimise and own a modern Databricks Lakehouse environment. You will play a key role in driving engineering best practice, improving automation and enabling scalable data solutions across a growing data function.

The Company

They are a large, well‑established organisation known for combining deep technical expertise with a people‑first culture. With a nationwide presence and a modern approach to flexible working, they invest heavily in technology, innovation and colleague development. Their data function is expanding and plays a central role in supporting transformation, decision‑making and future AI initiatives. You will join a collaborative team that values engineering excellence, autonomy and continuous improvement.

The Role

As Lead Data Platform Engineer, you will:

• Develop and deploy Databricks Lakehouse platform solutions within Azure.

• Build and maintain automation for clusters, tagging, monitoring and platform operations.

• Architect and design end‑to‑end data platform solutions focused on scalability, security and reliability.

• Lead delivery using Databricks, PySpark, Spark SQL and Azure Data Factory.

• Drive DevOps best practices including CI/CD, automated testing and infrastructure as code.

• Collaborate closely with data engineers, ML engineers and wider technical teams to deliver robust platform capabilities.

• Take ownership of key data platform projects and influence engineering direction.

• Provide technical leadership and ensure standards, patterns and best practices are followed.

Your Skills and Experience

You will bring:

• Strong commercial experience in Azure and Databricks, with deep knowledge of Lakehouse architecture.

• Proficiency in PySpark, Python, SQL and Spark SQL.

• Strong DevOps engineering skills including CI/CD, automated testing and deployment pipelines.

• Experience with monitoring, logging and alerting solutions.

• Ability to design, build and optimise cloud platform solutions.

• Stakeholder management skills and confidence working across multiple teams.

• API development experience.

• Azure Data Factory knowledge is beneficial.

What They Offer

• Salary between £80,000 and £85,000 plus bonus.

• Comprehensive benefits package and annual pay review.

• Flexible by choice working environment with remote‑first culture.

• 35‑hour working week promoting genuine work‑life balance.

• Opportunities to shape platform strategy and contribute to future AI and automation initiatives. xwzovoh

How to Apply

If you are a strong Data Platform Engineer with deep Databricks expertise and want to take ownership of a modern Azure Lakehouse environment, please apply today.