Junior Data Engineer
Location: UK-based, hybrid working
Security Clearance: BPSS or SC clearance Required
Working Style: Agile, product-led delivery
We are looking for a Junior Data Engineer to support the design, build and operation of scalable data platforms for digital services.
Working as part of a multidisciplinary agile team, you will support senior engineers in developing data pipelines, managing data stores, improving data quality and helping ensure data is secure, reliable and available in line with DDaT standards and best practice.
Role Responsibilities
You will support the development and maintenance of batch and streaming data pipelines, including exposure to Kafka and cloud-native data services.
You will work with relational databases such as AWS Aurora PostgreSQL, writing and optimising SQL queries for reporting, analytics and operational use cases.
The role will also involve supporting containerised data workloads using Docker and gaining exposure to deployments on Kubernetes platforms.
You will assist with data modelling and data warehouse structures, including logical and physical data models and star/snowflake schema concepts.
A key part of the role will be supporting data validation, reconciliation and monitoring to ensure data assets are accurate, reliable and fit for use.
You will also help integrate data from internal and external systems via REST APIs, working with JSON payloads, authentication, pagination and basic error handling.
Essential Skills
- Strong SQL fundamentals, including joins, aggregations and subqueries
- Understanding of ETL / ELT concepts and data pipelines
- Exposure to Apache Kafka or similar streaming platforms
- Basic knowledge of AWS services, particularly managed databases
- Awareness of Docker and Kubernetes concepts
- Understanding of REST APIs, HTTP methods and JSON payloads
- Ability to consume data from APIs as part of a data pipeline
- Good problem-solving skills and ability to troubleshoot basic data issues
Desirable Skills
- Experience with AWS Aurora PostgreSQL
- Basic understanding of data modelling techniques
- Familiarity with data warehousing concepts
- Experience integrating third-party or internal APIs
- Familiarity with Swagger / OpenAPI
- Awareness of API security, including tokens, API keys and OAuth
- Exposure to Git
- Understanding of Agile delivery principles
Experience Required
- 3+ years’ experience in data engineering, analytics or software engineering
- Exposure to cloud data platforms in a delivery environment
- Comfortable working in an agile, multidisciplinary team
- Willingness to learn under the guidance of senior engineers
This is a strong opportunity for a developing Data Engineer to build hands-on experience across cloud data platforms, streaming, APIs, SQL, containers and modern digital delivery environments.
…