Azure Databricks Engineer

{ “@context”: “http://schema.org”, “@type”: “JobPosting”, “title”: “Azure Databricks Engineer”, “description”: “

Azure Databricks Engineer

We are seeking an Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics, and next-generation engineering capabilities. This role requires strong experience working within the Lloyd's of London or wider London Market insurance environment, with the ability to deliver data solutions that meet strict regulatory, audit, and operational standards.

About the Role

You will take ownership of designing, building and optimising large-scale Azure data solutions, working closely with business and technical stakeholders to translate complex data challenges into secure, scalable, and production-ready platforms. You will help shape cloud data strategy, define engineering best practice, and guide delivery across cross-functional teams.

Responsibilities

  • Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks.
  • Deliver reliable, high-quality data pipelines.
  • Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit, and data governance requirements.
  • Promote best practices in engineering, automation, and cloud design.
  • Lead and mentor engineers, setting technical standards.
  • Improve platform performance, resilience, and cost efficiency.

Skills and Experience

  • Extensive engineering experience across Azure Data Services and Databricks in enterprise environments.
  • Proven delivery experience within the Lloyd's of London or London Market insurance sector.
  • Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, and data modelling.
  • Strong Python, PySpark, and Spark SQL capability.
  • Solid understanding of data governance.
  • Proven track record of ownership, delivery, and operating effectively in fast-paced environments.

What's on Offer

  • Salary of up to £95,000.
  • Performance-related bonus scheme.
  • Hybrid working – up to 3 days working from home.
  • Comprehensive benefits package.

#J-18808-Ljbffr”, “datePosted”: “2026-05-15”, “hiringOrganization”: { “@type”: “Organization”, “name”: “Cyber Security training courses”, “sameAs”: “https://uk.whatjobs.com/pub_api__cpl__432622439__4861?utm_campaign=publisher&utm_medium=api&utm_source=4861&geoID=33” }, “jobLocation”: { “@type”: “Place”, “address”: { “@type”: “PostalAddress”, “addressLocality”: “London” } } }
Company: Cyber Security training courses
Apply for the Azure Databricks Engineer
Location: London
Job Description:

Azure Databricks Engineer

We are seeking an Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics, and next-generation engineering capabilities. This role requires strong experience working within the Lloyd’s of London or wider London Market insurance environment, with the ability to deliver data solutions that meet strict regulatory, audit, and operational standards.

About the Role

You will take ownership of designing, building and optimising large-scale Azure data solutions, working closely with business and technical stakeholders to translate complex data challenges into secure, scalable, and production-ready platforms. You will help shape cloud data strategy, define engineering best practice, and guide delivery across cross-functional teams.

Responsibilities

  • Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks.
  • Deliver reliable, high-quality data pipelines.
  • Work with stakeholders to ensure solutions meet Lloyd’s of London regulatory, audit, and data governance requirements.
  • Promote best practices in engineering, automation, and cloud design.
  • Lead and mentor engineers, setting technical standards.
  • Improve platform performance, resilience, and cost efficiency.

Skills and Experience

  • Extensive engineering experience across Azure Data Services and Databricks in enterprise environments.
  • Proven delivery experience within the Lloyd’s of London or London Market insurance sector.
  • Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, and data modelling.
  • Strong Python, PySpark, and Spark SQL capability.
  • Solid understanding of data governance.
  • Proven track record of ownership, delivery, and operating effectively in fast-paced environments.

What’s on Offer

  • Salary of up to £95,000.
  • Performance-related bonus scheme.
  • Hybrid working – up to 3 days working from home.
  • Comprehensive benefits package.

#J-18808-Ljbffr…

Posted: May 15th, 2026