Quality Assurance Manager

Company: La Fosse
Apply for the Quality Assurance Manager
Location: Greater London
Job Description:

QA Manager – £650 outside IR35 – London (3 days per week in the office) – 6 month contract

This is a six‑month contract role with an expectation of being in the office three days per week.

La Fosse are currently supporting a leading organisation undergoing a major AI transformation, and they’re looking for an Quality Assurance Manager to help shape and build their entire AI testing and evaluation framework from the ground up.

This is a hands‑on contract role where you’ll define the standards, tools, and methods that ensure their AI products — including LLM-based tools, RAG systems, and third‑party AI platforms — are accurate, reliable, safe, and aligned to user needs.

Key experience:

  • Strong background in testing/evaluating AI or software systems, ideally with NLP/LLM exposure
  • Running hands‑on testing across prototypes, PoCs, and production tools
  • Supporting vendor assessments and POCs with robust test protocols
  • Understanding of prompt evaluation, semantic search, hallucination detection, bias analysis, and LLM behavioural nuances
  • Experience with tools such as TruLens, HumanLoop, PromptLayer, or similar
  • Knowledge of RAG pipelines, embeddings, modern AI architectures, and API integrations (OpenAI, Azure OpenAI, Anthropic, etc.)
  • Ability to design structured test regimes in evolving, ambiguous environments
  • Excellent communication skills and confidence working with both technical teams and business users
  • Proven experience producing frameworks, documentation, and training materials for handover

#J-18808-Ljbffr…

Posted: March 10th, 2026