Data Software Engineer – Azure Databricks
Location: London, UK
Duration: 6 months, with extensions expected
Description
We're looking for a Data Software Engineer – Azure Databricks to join our client team in London, UK in a hybrid working mode. In this role, you will design and implement data engineering solutions leveraging Azure Databricks and related Azure services to build large-scale, high-performance data pipelines. You will collaborate across teams to meet project requirements, deliver robust solutions and optimize data processing for massive datasets, ensuring project success in a collaborative, fast-paced environment.
Responsibilities
- Develop and implement scalable data engineering solutions using Azure Databricks
- Design and optimize data pipelines for multi-million record datasets
- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions
- Monitor and enhance performance of data workflows across Azure services
- Participate in stakeholder discussions and communicate project status effectively
- Identify and resolve technical issues, escalating as appropriate for timely resolution
Requirements
- 6-8 years of experience in Data Engineering, with mastery of Azure Databricks
- Proven experience in designing and implementing complex data pipelines using Azure Data Factory and Databricks
- Knowledge of Scala for development is highly desirable
- Strong performance optimization experience for large-scale data environments
- Solid understanding of Azure cloud services and data processing frameworks
Nice to Have
- Experience in Agile delivery frameworks and practices
- Databricks certification
- Familiarity with CI/CD pipelines for data engineering projects
Data Software Engineer – Azure Databricks
Location: London, UK
Duration: 6 months, with extensions expected
Description
We’re looking for a Data Software Engineer – Azure Databricks to join our client team in London, UK in a hybrid working mode. In this role, you will design and implement data engineering solutions leveraging Azure Databricks and related Azure services to build large-scale, high-performance data pipelines. You will collaborate across teams to meet project requirements, deliver robust solutions and optimize data processing for massive datasets, ensuring project success in a collaborative, fast-paced environment.
Responsibilities
- Develop and implement scalable data engineering solutions using Azure Databricks
- Design and optimize data pipelines for multi-million record datasets
- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions
- Monitor and enhance performance of data workflows across Azure services
- Participate in stakeholder discussions and communicate project status effectively
- Identify and resolve technical issues, escalating as appropriate for timely resolution
Requirements
- 6-8 years of experience in Data Engineering, with mastery of Azure Databricks
- Proven experience in designing and implementing complex data pipelines using Azure Data Factory and Databricks
- Knowledge of Scala for development is highly desirable
- Strong performance optimization experience for large-scale data environments
- Solid understanding of Azure cloud services and data processing frameworks
Nice to Have
- Experience in Agile delivery frameworks and practices
- Databricks certification
- Familiarity with CI/CD pipelines for data engineering projects
#J-18808-Ljbffr…