Data Science Subject Matter Expert - AI Evaluation (UK-Remote)
16 hours ago Be among the first 25 applicants
This range is provided by Braintrust. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range
$75.00/hr - $90.00/hr
Job Description:
Seeking multiple Data Science Subject Matter Experts to help design, run, and optimize data collection and evaluation workflows for GenAI research.
You’ll translate high-level research needs into scalable processes, produce and curate challenging domain problems, and ensure factual, bias-aware, high-quality datasets for LLM training.
- To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.
- To Note: Hourly rate range (75 - 90) is in USD per hour
Responsibilities:
- Partner with GenAI researchers/engineers to capture data needs and success criteria.
- Expand high-level requirements into clear, executable workflows for larger teams.
- Execute collection/evaluation workflows rapidly with minimal supervision.
- Innovate on workflows to maximize throughput and quality.
- Collaborate cross-functionally to maintain quality at scale.
- Conduct in-depth LLM-assisted research; gather reliable, up-to-date info.
- Craft original, high-quality content and hard problems for LLM eval/train.
- Perform rigorous fact-checking (precision/recall) to prevent misinformation.
Requirements:
- Education: Master’s with distinction or PhD in Data Science; top-tier institution preferred. Significant domain experience considered.
- Detail orientation; precise data presentation; thorough proofreading.
- Communication: articulate complex info; strong collaboration.
- Understanding of AI/LLMs, their capabilities/limits.
- Prompt engineering and familiarity with AI writing tools.
- Ethical AI awareness and data literacy (collection, cleaning, transformation).
- Thrives in fast-paced, minimally supervised environments.
Seniority level
Employment type
Job function
- Engineering, Information Technology, and Science
Industries
- Technology, Information and Internet, Data Infrastructure and Analytics, and IT System Data Services
#J-18808-Ljbffr