Consultant – Manager, Data Engineer, AI & Data, Defence & Security

Company: HM Revenue & Customs (HMRC)
Apply for the Consultant – Manager, Data Engineer, AI & Data, Defence & Security
Location: Bristol
Job Description:

Overview

Connect to your opportunity: As a practitioner, you bridge the gap between our customers’ needs and technical solutions. Your primary responsibility is to make data valuable for our clients by developing pipelines that ingest, transform, and enrich high‑volume, varied data into accessible, trusted information assets that can be used to derive actionable insights.

Responsibilities

In your role, you will have responsibility for deliverables and client stakeholder relationships and will be delivering solutions for our clients using agile methodologies. You will often be working in multi‑disciplinary teams across a range of industries, subject matters, and locations.

  • Apply data engineering tools, integration frameworks, and query engines to create high quality, standardised data for downstream use cases, such as AI and reporting.
  • Design and implement high quality data pipelines and data stores, coordinating efforts with other developers and engineers.
  • Bring innovation and novel approaches to solve challenging data engineering problems.
  • Architect and implement solutions for scale and complexity that provide value across many teams and consumers.
  • Develop logical and physical data modelling and governance strategy, establishing standards across teams.

Qualifications

All applicants must be willing and eligible to apply and obtain UK security clearance to Developed Vetting level, if not holding an existing clearance.

Technical Skills

  • Ingesting, transforming, enriching, and integrating data from diverse sources into well‑structured information assets.
  • Distributed computing techniques such as parallel processing, streaming, batch workflow orchestration that enable handling large data volumes.
  • ETL, data pipelines, and automated workflows for moving and processing data.
  • Optimising data systems for performance, scalability, reliability, and monitoring.
  • Information security including access controls, encryption, and anonymity for sensitive data assets.
  • Data governance, including metadata management, data quality, and lineage tracking.

Business & Professional Experience

  • End‑to‑end development experience with data pipelines, ETL processes, workflow orchestration – using core concepts that apply across tech stacks.
  • Working with diverse data sources and types – batch, streaming, real‑time, and unstructured.
  • Systems thinking and architectural design skills for building scalable, high‑performance data solutions.
  • Data modelling, warehouse design, database optimisation knowledge – with samples of logical/physical models that reflect proficiency.
  • Deploying and managing distributed data systems.
  • Ability to monitor, troubleshoot, and tune these systems for reliability and performance.
  • Coding experience that demonstrates modularity, reusability, and efficiency across languages.
  • Understanding of full development lifecycle, SDLC concepts, version control, CI/CD pipelines.
  • Knowledge of data security, governance, metadata management, master data principles.
  • Communication skills, ability to understand business requirements and translate to technical data solutions.

Location & Working Arrangement

You’ll be based in Bristol, London, or Manchester with hybrid working. The role offers flexibility to work in your local office, virtual collaboration spaces, client sites, and remotely, depending on the requirements of the role.

#J-18808-Ljbffr…

Posted: June 3rd, 2026