Overview
Job Title: Data Architect – Azure Databricks / Azure Data Factory For London Market Insurance
Experience Required: 10 years Plus
Location: London
About the Job you are considering: We are looking for an experienced Data Architect with strong expertise in Azure Databricks, Azure Data Factory, Azure Data Lake, Delta Lake, data modelling, data governance, and cloud data architecture, along with domain experience in London Market Insurance. The candidate will be responsible for defining and delivering scalable data architecture solutions for insurance transformation programmes covering underwriting, claims, policy administration, bordereaux, delegated authority, premium processing, regulatory reporting, reinsurance, analytics, and data migration. The ideal candidate should have strong hands-on architecture experience in Azure-based data platforms and should be able to work closely with business stakeholders, enterprise architects, solution architects, data engineers, insurance SMEs, vendors, and delivery teams.
Hybrid working: The places you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home, noting that you will be unable to work at home 100% of the time.
Key Responsibilities
- Define end-to-end data architecture for Azure-based data platforms using Azure Databricks, Azure Data Factory, ADLS Gen2, Delta Lake, Azure Synapse, and Power BI.
- Design scalable and secure lakehouse architecture using bronze, silver, and gold data layers.
- Lead architecture and design for data ingestion, transformation, curation, data marts, reporting, and analytics solutions.
- Create high-level and low-level data architecture documents, data flow diagrams, integration architecture, and data platform blueprints.
- Define architecture patterns for batch, incremental, real-time, and API-based data ingestion.
- Design reusable data ingestion and transformation frameworks using ADF and Databricks.
- Define data models for London Market Insurance data including policy, claims, premium, broker, bordereaux, delegated authority, reinsurance, exposure, and regulatory reporting data.
- Work with business analysts and insurance SMEs to understand London Market business processes and translate requirements into data architecture.
- Define standards for data modelling, source-to-target mapping, data quality, reconciliation, metadata, lineage, and auditability.
- Design data governance, security, access control, and compliance frameworks for insurance data.
- Support cloud migration, data warehouse modernisation, reporting transformation, and legacy system decommissioning initiatives.
- Review technical designs, data models, ETL/ELT pipelines, and engineering implementation.
- Provide architectural guidance to data engineers working on Azure Databricks, ADF, PySpark, SQL, and Delta Lake.
- Collaborate with enterprise architecture, solution architecture, security, infrastructure, DevOps, and business teams.
- Define CI/CD, DevOps, deployment, monitoring, and operational support architecture for data platforms.
- Identify performance, scalability, reliability, and cost optimisation opportunities across Azure data services.
- Support governance forums, architecture review boards, design authority meetings, and client stakeholder workshops.
Mandatory Skills
- Strong experience as a Data Architect or Senior Data Architect.
- Strong hands-on experience with Azure Databricks.
- Strong architecture and implementation experience with Azure Data Factory.
- Strong understanding of Azure Data Lake Storage Gen2.
- Strong experience with Delta Lake, lakehouse architecture, and medallion architecture.
- Excellent knowledge of data modelling, dimensional modelling, canonical data models, and enterprise data models.
- Strong experience in designing ETL/ELT data pipelines.
- Good understanding of PySpark, Spark SQL, Python, and SQL.
- Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture.
- Experience in defining data quality, data validation, reconciliation, audit, and exception handling frameworks.
- Experience with data governance, metadata management, data lineage, data catalogue, and data privacy controls.
- Experience with Azure security concepts including Managed Identity, Azure RBAC, Key Vault, ACLs, private endpoints, and encryption.
- Experience with CI/CD and DevOps practices using Azure DevOps, Git, ARM templates, Bicep, or Terraform.
- Strong stakeholder management, communication, presentation, and documentation skills.
- Ability to lead architecture discussions with business, technology, and senior client stakeholders.
- London Market Insurance Domain Experience including exposure to Lloyd’s Market operations, London Market Insurance operating model, specialty and commercial insurance, data flows for broker, carrier, and syndicate, underwriting data architecture, claims data architecture, policy administration data, premium and claims accounting, bordereaux processing, delegated authority and binder data, coverholder data, exposure management, reinsurance data, regulatory and compliance reporting, financial and management reporting, and London Market data initiatives.
- Azure Architecture Skills Expected: Azure Databricks, Lakehouse, Databricks notebooks/jobs/workflows/clusters, Delta Lake optimisation, Unity Catalog, Databricks SQL, cluster sizing and cost optimisation, security and access control patterns, Azure Data Factory components, ADLS Gen2 architecture, governance and security concepts including Key Vault, Managed Identity, Azure RBAC, private endpoints, data masking, encryption, logging/monitoring/audit controls.
Disability Confident Employer
Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:
- Declare they have a disability, and
- Meet the minimum essential criteria for the role.
Please opt in during the application process.
#J-18808-Ljbffr…