About the Job you are considering
We are seeking an experienced Azure Data Engineering Lead with deep expertise in Azure Databricks, Azure Data Factory (ADF), PySpark, SQL, Delta Lake, and Azure cloud-native data services to drive the design and delivery of enterprise‑scale data platforms for leading banking and financial services clients.
The ideal candidate will possess strong hands‑on data engineering experience, a proven track record of leading teams, and extensive exposure to modern cloud‑based data architectures. This role requires expertise in building secure, scalable, and high‑performance data solutions capable of processing large volumes of structured, semi‑structured, and streaming data within highly regulated banking environments.
Hybrid Working
The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.
Responsibilities
- Strong hands‑on experience with Azure Databricks, Azure Data Factory (ADF), and ADLS Gen2.
- Expertise in designing scalable, resilient, and enterprise‑grade Azure data solutions.
- Advanced proficiency in PySpark, Python, Spark SQL, and SQL.
- Strong experience with SQL optimization, performance tuning, joins, window functions, and stored procedures.
- Extensive experience in developing and optimizing large‑scale ETL/ELT pipelines.
- Strong knowledge of Delta Lake, Lakehouse, and Medallion Architecture.
- Experience integrating data from databases, APIs, files, cloud storage, and streaming sources.
- Expertise in data quality, validation, reconciliation, lineage, audit, and monitoring frameworks.
- Strong understanding of data governance, regulatory reporting, compliance, and data quality standards.
- Hands‑on experience with Azure DevOps, Git, CI/CD pipelines, release management, and automation.
- Experience with job scheduling, orchestration, dependency management, and error handling frameworks.
- Strong knowledge of Azure security including Key Vault, Managed Identities, RBAC, encryption, and secure access controls.
- Experience working in Banking and Financial Services environments with a strong focus on security, governance, risk, and compliance.
Qualifications
- Experience leading data engineering teams and large‑scale delivery engagements.
- Knowledge of streaming technologies such as Azure Event Hub or Kafka.
- Understanding of data warehousing concepts and modern analytical platforms.
- Experience with regulatory and compliance‑driven banking data environments.
- Azure Data Engineering certifications are highly desirable.
Disability Confident Employer
We are a Disability Confident Employer. Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who declare they have a disability, and meet the minimum essential criteria for the role. Please opt in during the application process.
#J-18808-Ljbffr…