Assessment Specialist

Company: Sourced
Apply for the Assessment Specialist
Location:
Job Description:

  • Role: Assessment Specialist
  • Location: Remote
  • Employment Type: Full-time

Compensation: Competitive salary commensurate with experience, qualifications, and location. Indicative range: $55,000 – $90,000 (USD equivalent), plus benefits.

Role Overview

We are hiring an Assessment Specialist to design, validate, and improve assessments across our learning programs. The role combines psychometric rigor with strong content sense — building assessments that measure what they claim to measure.

Key Responsibilities

– Design assessment items, rubrics, and scoring guides aligned to learning outcomes

– Conduct item analysis, reliability testing, and validation studies

– Maintain item banks and assessment blueprints

– Partner with subject matter experts on item review and content alignment

– Train scorers and ensure inter-rater reliability for rubric-based assessments

– Document psychometric methodology and assessment design decisions

Required Skills and Qualifications

– 3+ years in assessment design, psychometrics, or educational measurement

– Strong understanding of assessment validity, reliability, and item analysis

– Familiarity with statistical analysis tools (R, SPSS, Excel)

– Excellent writing and editing skills

– Master’s degree in measurement, psychometrics, or education preferred

– Experience with assessment platforms and item banking systems

What You’ll Bring

– Genuine passion for learner outcomes and continuous improvement of materials

– Clear written communication and the ability to break down complex topics

– Openness to feedback and a willingness to iterate based on learner data

– Comfort working asynchronously across time zones

What We Offer

– Fully remote, flexible work hours

– Performance-based bonus structure

– Annual learning & development stipend

– Health and wellness benefits (varies by location)

– Opportunity to work on high-scale, real-world impact projects

Equal Opportunity Statement

This is an equal opportunity role. Applications are welcomed from all qualified individuals regardless of race, color, ethnicity, nationality, gender, gender identity or expression, sexual orientation, age, religion, disability, marital status, or any other characteristic protected by applicable law. All hiring decisions are based solely on qualifications, skills, and demonstrated ability.

Posted: May 3rd, 2026