Engineering Lead – Enterprise Data Platform

Engineering Lead – Enterprise Data Platform (Barclays) – Customer, Comms and MarTech

Lead the technical design and delivery of data solutions supporting the migration to a cloud‑based Enterprise Data Platform (EDP). Shape how data is provisioned, configured, integrated, and consumed to enable scalable, secure, and efficient data capabilities across the organisation.

Responsibilities

• Lead engineering solution design, define new data architecture patterns, including orchestration and scheduling, and ensure seamless integration with downstream systems.
• Drive the design and build of scalable data pipelines and integrations on AWS.
• Migrate customer and MarTech datasets from legacy platforms to the EDP.
• Establish robust DevOps and DataOps practices to ensure production‑ready, reliable and high‑performing data products.
• Maintain high standards of data quality, security and operational resilience.
• Collaborate with product managers, designers and other engineers to define requirements and ensure alignment with business objectives.
• Promote a culture of code quality and knowledge sharing through code reviews and unit testing practices.

Required Qualifications

• Strong hands‑on expertise in Python, PySpark, SQL and Databricks for building and optimising scalable data pipelines and analytics‑ready datasets.
• Experience implementing CI/CD and DevOps practices for data platforms, including GitLab workflows, automated testing, deployment pipelines and environment management.
• Proven experience delivering AWS solutions with a focus on performance tuning, monitoring, data quality, security and cost optimisation.

Highly Valued Skills

• Understanding of Enterprise Data Platform concepts, including data products, domains and consumption patterns with a focus on operability and production readiness.
• Awareness of data security practices, particularly in handling sensitive data using governed and automated approaches.
• Experience with file‑based integration patterns, including managing constraints around file formats, splitting and downstream system limitations.

Location

Knutsford.

#J-18808-Ljbffr…