QA Manager – £650 outside IR35 – London (3 days per week in the office) – 6 month contract
This is a six‑month contract role with an expectation of being in the office three days per week.
La Fosse are currently supporting a leading organisation undergoing a major AI transformation, and they’re looking for an Quality Assurance Manager to help shape and build their entire AI testing and evaluation framework from the ground up.
This is a hands‑on contract role where you’ll define the standards, tools, and methods that ensure their AI products — including LLM-based tools, RAG systems, and third‑party AI platforms — are accurate, reliable, safe, and aligned to user needs.
Key experience:
- Strong background in testing/evaluating AI or software systems, ideally with NLP/LLM exposure
- Running hands‑on testing across prototypes, PoCs, and production tools
- Supporting vendor assessments and POCs with robust test protocols
- Understanding of prompt evaluation, semantic search, hallucination detection, bias analysis, and LLM behavioural nuances
- Experience with tools such as TruLens, HumanLoop, PromptLayer, or similar
- Knowledge of RAG pipelines, embeddings, modern AI architectures, and API integrations (OpenAI, Azure OpenAI, Anthropic, etc.)
- Ability to design structured test regimes in evolving, ambiguous environments
- Excellent communication skills and confidence working with both technical teams and business users
- Proven experience producing frameworks, documentation, and training materials for handover
#J-18808-Ljbffr…
