Salary
Salary: £? – ? per year
Requirements
- Strong experience delivering quality assurance for AI/ML solutions across the full lifecycle
- Hands-on expertise with Microsoft-based environments, such as Azure testing tools and AI platforms
- Proficiency in one or more of the following: Python, Java, JavaScript, SQL, or R
- Proven experience with AI and generative AI testing
- Proven experience validating RAG solutions, including use of the RAGAS framework
- Proven experience with CI/CD, DevOps, and cloud-based test integration
- Ability to define and implement AI testing strategies and model validation frameworks
- Strong understanding of functional and non-functional testing
- Strong understanding of accessibility, security, and performance testing
- Experience working in regulated or enterprise environments
- Active SC Clearance is mandatory
Responsibilities
- Lead the design and execution of end-to-end test strategies across AI and digital programmes
- Ensure quality across AI models, data pipelines, APIs, and cloud-based services
- Embed test-driven development and behaviour-driven development practices within engineering teams
- Drive improvements in automation frameworks and testing tools
- Provide expert oversight on AI model validation, including generative AI and RAG solutions
- Identify risks early and implement mitigation strategies
- Mentor and coach engineers to build strong testing capability across teams
- Define and deliver testing strategies aligned to organisational standards
- Lead AI testing, validation, and evaluation frameworks
- Integrate testing within CI/CD and DevOps pipelines
- Champion modern testing approaches, including AI-led and predictive testing techniques
- Collaborate with cross-functional teams including engineering, data science, product, and leadership
- Oversee defect management, quality metrics, and release assurance
- Ensure compliance with accessibility, security, and performance standards
Technologies
- AI
- Azure
- CI/CD
- Cloud
- DevOps
- Java
- JavaScript
- Python
- SQL
- Security
- TDD
Engagement
6-month initial contract for a Senior Test Engineer (AI) in London on a hybrid basis. This is an inside IR35 role and must be engaged through an umbrella company. The role focuses on delivering high-quality, reliable artificial intelligence and data-driven solutions in a complex, enterprise-scale environment, with a strong focus on governance, validation, automation, and continuous quality improvement.
#J-18808-Ljbffr…
