Overview
Prolific is building the biggest pool of quality human data in the world, with over 35,000 AI developers, researchers, and organizations using our platform.
Role
Senior Python Developer – join our Expert Network to train and evaluate cutting‑edge AI models. Successful candidates will assist researchers by reviewing code, logic, and performance of AI‑generated Python scripts and providing expert feedback.
What you’ll bring
- Educational Background: BSc or higher in Computer Science, Software Engineering, or closely related technical field.
- Professional Experience: real‑world experience as a Senior Software Engineer/Developer specializing in Python.
- Coding Proficiency: ability to solve LeetCode Medium to Hard‑level problems in Python independently.
- Deep Domain Knowledge: expert understanding of the GIL, decorators, generators, memory management, and asynchronous patterns (asyncio, async/await).
- Code Quality: adherence to clean‑code principles, modularity, readability, and modern Pythonic standards (PEP 8, PEP 20).
- Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities in model‑generated code.
What you’ll be doing
- Evaluate Code Accuracy: review AI‑generated Python code for functional correctness and best‑practice compliance.
- Validate Logic & Reasoning: audit step‑by‑step explanations provided by AI to ensure logical soundness.
- Conduct Execution Testing: run model‑generated scripts in appropriate environments to verify performance and output.
- Annotate Model Performance: identify areas where a model offers inefficient solutions, deprecated syntax, or hallucinated library methods.
- Refine Technical Logic: provide structured feedback on how models reason through backend architecture, data pipelines, or API design discussions.
Key Technologies
- Core Language: expert mastery of Python 3.x, including type hints and modern language features.
- Frameworks: extensive experience with Django, FastAPI, or Flask.
- Testing & Tools: proficiency with pytest, unittest, coverage.py, and tox.
- Backend & API: strong understanding of RESTful APIs, GraphQL, and server‑side logic in a Python environment (e.g., FastAPI or Django REST Framework).
Compensation
Researchers pay up to $50 per hour, depending on skills and experience level, for paid tasks requiring one hour of uninterrupted work.
#J-18808-Ljbffr