Senior Data & Automation Test Engineer (Cloud)

Test Engineer (Data & Automation)

Overview

We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud‑based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.

This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms.

Key Responsibilities

• Design, develop, and maintain automated test frameworks to improve testing efficiency and coverage
• Analyse and interpret test results, identifying risks, issues, and areas for improvement
• Produce clear reports on testing activities, outcomes, and associated risks
• Automate data validation and application testing processes across distributed systems
• Investigate production issues using data analysis to identify root causes
• Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures
• Validate data using tools such as Jupyter Notebooks and Amazon Athena
• Analyse data across multiple formats to ensure integrity and correctness of new functionality
• Support CI/CD practices using Git‑based workflows and pipeline automation
• Participate in infrastructure and deployment activities, including containerisation and Infrastructure as Code
• Collaborate with cross‑functional teams to translate business requirements into testable solutions
• Mentor and guide team members on testing methodologies and best practices

Key Skills & Experience

Technical Skills

• Proficiency in Python, SQL, and at least one additional programming language (e.g., Java)
• Experience with scripting languages such as Bash
• Strong understanding of automated testing frameworks and methodologies
• Hands‑on experience with Apache Airflow and log analysis
• Familiarity with data processing tools such as Apache Spark
• Experience working with cloud platforms and services, including:
• Monitoring and logging tools
• Storage and data services
• Compute and container services
• Experience with CI/CD pipelines and version control systems (e.g., GitLab)
• Knowledge of Infrastructure as Code (e.g., Terraform)
• Familiarity with Docker and containerised environments

Data & Analytics

• Strong data analysis skills, including working with structured and semi‑structured data
• Experience validating and querying data using tools such as Athena and notebooks
• Understanding of data modelling concepts, including dimensional models and slowly changing dimensions
• Ability to generate realistic test data for various scenarios

Additional Knowledge

• Understanding of distributed data platforms and big data environments (e.g., EMR)
• Knowledge of encryption principles (client‑side and server‑side)
• Awareness of production system monitoring and incident analysis

Soft Skills

• Strong analytical and problem‑solving abilities
• Excellent communication skills, with the ability to present findings clearly
• Proactive approach to identifying and mitigating risks
• Ability to mentor and support less experienced team members
• Collaborative mindset with experience working in agile delivery environments

Working Arrangements

UK‑based role with flexible location. Occasional travel required for team collaboration sessions and workshops.

#J-18808-Ljbffr…