Senior Data Pipeline Engineer

Salary: £70,000 – 80,000 per year

Requirements

• We need at least 5 years of hands‑on experience designing, building and operating telemetry or observability data pipelines in enterprise environments.
• We need senior data pipeline engineering experience with a demonstrable track record at enterprise scale.
• We need hands‑on experience designing, deploying and operating observability platforms across cloud, hybrid and on‑premises environments.
• We need strong practical experience with data transformation, including parsing, routing, filtering, enrichment and normalisation of log, metric and trace data.
• We need hands‑on experience with one or more industry‑standard observability platforms and their architecture, deployment and data‑pipelining functionality.
• We need the ability to mentor junior engineers and plan and allocate tasks within an engagement team.
• We prefer consulting experience, though it is not essential.
• We need strong working knowledge of the OpenTelemetry Collector and OTLP.
• We need scripting and automation skills in Python and Bash.
• We need familiarity with JSON, regex, syslog and common log, metric and trace formats.
• We need cloud platform knowledge across AWS, Azure and/or GCP.
• We need experience with Kubernetes, Docker and OpenShift.
• We need familiarity with delivery and project tooling such as JIRA, Confluence and ServiceNow.
• We prefer certification in one or more relevant observability platforms or tools, such as Dynatrace, OpenTelemetry, Cribl, Elastic or Splunk.
• We need the right to work in the United Kingdom.
• We need willingness to work from our Brighton or London office and travel to UK client sites as required.

Responsibilities

• We design, build and operate telemetry pipelines that collect, route, transform, enrich, reduce and mask logs, metrics and traces at enterprise scale.
• We develop and maintain data transformation logic, including parsing, restructuring, filtering and normalising telemetry across formats and schemas.
• We optimise pipelines for data quality, cost control and performance.
• We onboard complex applications and data sources onto observability platforms.
• We build, test and document reusable pipeline configurations, processors and templates.
• We monitor pipeline health and throughput, and troubleshoot ingestion, routing and delivery issues.
• We architect observability platform deployments to meet enterprise client requirements, including topology, sizing, high availability, resilience and scaling.
• We deploy, configure and operate observability platforms and collection/agent fleets across cloud, hybrid and on‑premises environments.
• We define deployment patterns and infrastructure as code for repeatable, automated platform rollouts.
• We integrate observability platforms with client infrastructure, data sources and downstream destinations.
• We own platform health, upgrades and capacity planning, and keep architecture and deployment documentation current.
• We deliver observability platform and pipeline engagements directly with enterprise clients.
• We own delivery outcomes for the platform and pipeline workstreams on assigned engagements.
• We act as the senior technical authority and escalation point for platform architecture, deployment and data pipeline issues.
• We lead troubleshooting and root‑cause analysis across enterprise observability platforms and telemetry pipelines.
• We support pre‑sales with technical scoping and solution design for platform and pipeline work.
• We translate client requirements into platform and pipeline designs that balance coverage, cost and compliance.
• We provide technical leadership on engagements, setting direction and quality standards for the workstream.
• We plan the workstream, scope the work, sequence tasks and allocate them across the delivery team where required.
• We mentor and coach junior engineers and consultants working alongside us.
• We coordinate with the wider engagement team and report progress on the workstream.
• We work hands‑on across the observability tool landscape and contribute to our methodology, toolkits and reusable assets.

Technologies

• AWS
• Architect
• Azure
• Bash
• Cloud
• Confluence
• Docker
• Dynatrace
• GCP
• Support
• JIRA
• JSON
• Kubernetes
• OpenTelemetry
• OpenShift
• Python
• ServiceNow
• Splunk

More

We are NETbuilder, a leading provider of digital solutions, software, consulting and managed services, with specialist expertise across financial services, government and commercial markets. Since 1999, we have delivered end‑to‑end solutions across Digital Delivery, Development and Technology as a digital transformation consultancy with onsite, onshore and offshore capability. You will join our world‑class team of experienced consultants as we build a new Observability Practice, working as a senior technical specialist on enterprise client engagements. This is a full‑time, permanent role based in Brighton or London, office‑based with travel to UK client sites, offering a competitive salary of £70,000 to £80,000, company pension, and ongoing investment in professional development and certification in a close‑knit, high‑performance culture.

last updated 26 week of 2026

#J-18808-Ljbffr…