Job Profile
We are looking for a Data Engineering Lead to provide technical leadership for a large-scale AWS data platform, ensuring it remains scalable, resilient, and capable of supporting growing business demands.
This is a senior, hands-on leadership role where you will drive the direction of the data platform, lead complex engineering initiatives, and establish best practices across data engineering and DataOps. Working closely with technology and business stakeholders, you will play a key role in shaping data strategy while mentoring and developing a team of engineers.
The role offers the opportunity to work with modern cloud technologies, large-scale datasets, and both batch and real-time data processing solutions, helping to deliver high-quality data products and insights across the organisation.
Responsibilities
- Lead the development, optimisation, and ongoing management of the organisation’s AWS-based data platform.
- Design and oversee the delivery of scalable batch and real-time data pipelines.
- Make key architectural decisions around data storage, modelling, integration, and engineering standards.
- Mentor and develop data engineers, promoting a culture of technical excellence and continuous improvement.
- Establish and maintain best practices across DataOps, testing, automation, monitoring, and code quality.
- Collaborate with architecture, security, and business teams to deliver reliable and scalable data solutions.
- Act as the senior technical authority for complex data engineering challenges and platform enhancements.
- Support the evolution of the organisation’s data strategy and future data capabilities.
Skills
Essential Experience
- Proven experience leading data engineering teams and large-scale cloud data platforms.
- Strong hands-on experience building and optimising data pipelines and integration solutions.
- Expertise working with large and complex datasets in enterprise environments.
- Strong knowledge of data warehouse and data lake architectures.
- Experience implementing DataOps and CI/CD practices within data engineering teams.
- Ability to balance technical leadership with hands-on engineering delivery.
- Excellent stakeholder management and communication skills.
Technical Skills
- Amazon Web Services (AWS)
- Python
- SQL
- Data Warehousing and Data Lakes
- ETL / ELT Development
- Batch and Real-Time Data Processing
- DataOps and CI/CD
…