Senior Manager, Databricks Architect, AI&Data, FS

Senior Manager – Data Engineering – Databricks Architect

Financial Services – London / Edinburgh

The opportunity

EY’s Financial Services AI & Data team is looking for a Senior Manager to lead the development of our Data Engineering Capability with an initial focus on Databricks on Azure. This senior architecture role requires an individual with an exceptional track record of delivering data transformation programs in the Financial Services sector.

Responsibilities

• Lead the design and implementation of scalable data architecture solutions using Databricks on Azure.
• Architect and optimize data pipelines for structured and unstructured financial data, ensuring performance, reliability, and compliance.
• Demonstrate prior experience in standing up and operationalising Databricks platforms, including workspace set‑up, cluster configuration, and CI/CD integration.
• Lead and execute large‑scale lift‑and‑shift data migrations from legacy platforms to Databricks, ensuring minimal disruption and high data fidelity.
• Collaborate with cross‑functional teams to align data architecture with financial regulations such as GDPR, Basel III, and MiFID II.
• Drive adoption of Delta Lake, Apache Spark, and MLflow for advanced analytics and machine learning use cases.
• Provide technical leadership and mentoring to data engineers and analysts across risk, trading, and compliance domains.
• Establish best practices for data governance, lineage, and metadata management within the Databricks environment.
• Translate business needs into robust data products that support real‑time decision‑making and predictive modelling.
• Lead performance tuning, cost optimisation, and security hardening of Databricks on Azure.

Qualifications

• Track record of delivering large Databricks data transformations and relevant industry certifications.
• Deep understanding of Financial Services to develop appropriate AI, Data, and Analytics solutions.
• Experience building high‑performing teams with exceptional leadership and interpersonal skills.
• Knowledge of emerging technology trends, cloud‑based technologies, and advanced data technologies.
• Ability to manage multiple engagements, exceed client expectations, and handle commercial aspects and risk.
• Strong stakeholder engagement and cross‑functional project management skills.
• Intellectual flexibility to understand complex problems and translate them into workable solutions.
• Excellent storytelling, communication, presentation, and business writing skills.
• Previous consulting experience is highly valued.
• University degree (2:1 or equivalent) preferred; exceptional candidates with an alternative path will be considered.

Benefits

• Competitive remuneration package with rewards for individual and team performance.
• Comprehensive Total Rewards package supporting flexible working and career development.
• Flexible benefits selection covering holidays, health, well‑being, insurance, savings, and discounts.
• Support, coaching, and feedback from engaging colleagues.
• Opportunities to develop new skills and progress your career.
• The freedom and flexibility to handle your role in a way that’s right for you.

Apply now and join EY in building a better working world.

#J-18808-Ljbffr…