Position Overview
Circa £45k, salary dependent on skills and experience.
Base location in either Lincoln or Huntingdon, depending on your location, with expectation to work from home and 2 days in office.
Permanent, full time, 37 hours per week.
Do you have prior experience of modern data engineering, including data modelling and working with real‑time or streaming data? Do you have experience of working within an Agile environment, or are keen to work in one? Do you enjoy exploring, learning and challenging yourself, and are you a strong team player? If you can answer yes to the above, we have an exciting opportunity for you with our expanding team.
Responsibilities
The Data Engineer is a T‑shaped professional with identifiable core skills, yet with the ability to work across multiple disciplines (both technical and non‑technical) as required.
The Data Engineer (Datacore / IOTT Platform) will deliver data solutions on our analytics and big data platform, act as a technical expert across real‑time and batch data platform delivery, build and maintain data pipelines that integrate industrial, IoT, and enterprise data sources into a secure, scalable cloud platform, and work in an Agile/Scrum environment in a squad model. You may be expected to lead within the squad and/or fulfil other roles as required.
- Design robust, secure, and supportable data solutions for both batch and streaming use cases, ensuring scalability, resilience, and security by design.
- Develop, test, and support data pipelines integrating data from industrial, IoT, and enterprise systems using Azure Synapse, and event streaming platforms (Event Hubs, Kafka, MQTT, Quix).
- Work with edge and integration platforms (HighByte, Ignition, Quix, or similar) to ingest, model, and standardise operational data, aligned to a Unified Namespace (UNS) approach.
- Build and optimise solutions for handling time‑series and telemetry data, ensuring performance and usability at scale.
- Collaborate with architects, cloud engineers, and platform teams to design and evolve data platform capabilities, including CI/CD, deployment automation, and environment management.
- Ensure data quality, observability, and reliability across real‑time and batch pipelines.
- Where required, contribute to downstream data modelling and analytics to support reporting and insight.
- Build automated test frameworks and develop test harnesses for each component, increasing overall test coverage and ensuring a culture of quality and reliability across the platform.
Qualifications
- Strong experience in data engineering using cloud platforms (e.g. Azure), including Azure Synapse, Spark, Python, and SQL.
- Experience working with real‑time or streaming data pipelines (Event Hubs, Kafka, MQTT, Quix, or similar).
- Experience working with time‑series or telemetry data.
- Experience integrating data from APIs, industrial systems, or edge platforms (HighByte, Ignition, or similar).
- Familiarity with Unified Namespace (UNS) principles and MQTT‑based architecture is advantageous.
- Experience in data modelling (relational modelling, dimensional modelling, or similar approaches suited to operational systems).
- Experience delivering end‑to‑end data solutions from ingestion through to production deployment.
- Experience working in an Agile/Scrum environment.
- Experience collaborating with platform and engineering teams to support CI/CD, DevOps, and engineering best practices.
- Knowledge of Azure DevOps or similar tools.
- Awareness of security, data governance, and working within regulated or operationally critical environments is desirable.
Benefits
- Personal private health care.
- 26 days annual leave – rising with length of service.
- Flexible working.
- Pension scheme – Anglian Water double‑matches your contributions up to 7%.
- Bonus scheme.
- Flexible benefits to support your wellbeing and lifestyle.
Inclusion & Equal Opportunity
Our customers come from a wide range of backgrounds, and we think our workplace should reflect that. We are committed to ensuring all colleagues feel they belong and are supported to succeed, and we hold a range of recognitions including the Social Mobility Pledge, Business in the Community’s Race at Work charter, Armed Forces Gold Covenant for Employers, and accredited Disability Confident employer status.
#J-18808-Ljbffr…