Senior AI Model Tester

We are looking for a Senior AI Model Tester to drive the quality, reliability, and performance of AI/ML systems across critical business use cases.

• Lead AI model quality assurance, evaluation, and benchmarking strategy
• Design frameworks to evaluate accuracy, drift, bias, and performance under stress
• Define and track AI KPIs (precision, recall, LLM evaluation metrics)
• Build automated validation pipelines across lower environments and path-to-live
• Identify and mitigate bias, rogue outputs, and model disparities
• Establish data quality standards for fair AI outcomes
• Implement MLOps practices within CI/CD pipelines
• Collaborate closely with engineering and DevOps teams

Required Experience

• 5+ years in QA / Software Engineering / Automation Testing
• 2–3 years specifically in AI/ML model testing
• Strong expertise in Python / Java and statistical analysis
• Deep understanding of AI/ML lifecycle and evaluation frameworks
• Experience with tools like LangSmith, Fiddler, InspectAI, OpenAI Evals
• Strong SQL skills and experience with large-scale or unstructured datasets / vector DBs
• Bachelor’s or Master’s in Data Science, Computer Science, Statistics, or related field
• Work on cutting-edge AI systems in real-world deployments
• Influence model governance, fairness, and performance standards
• Collaborate with high-impact engineering and AI teams

If you’re passionate about ensuring AI systems are accurate, fair, and production-ready, we’d love to hear from you.

#J-18808-Ljbffr…