Research Assistant – AI Agents & LLM Prototyping
Overview
We are looking for a Research Assistant with 2+ years of experience in prototyping and testing AI agents or large language models (LLMs). You will design test prompts, experiment with prompt engineering, and debug AI agent tool calls within a Python/PHP software stack. You’ll also help create internal benchmarks to evaluate AI agent performance.
Duration: 03-month (Likely extension)
Key Responsibilities
- Create and refine test prompts to guide AI agents toward desired behavior.
- Implement and troubleshoot AI agent tool calls in a Python/PHP environment.
- Develop high-quality prompts to build internal evaluation benchmarks for AI agents.
- Test AI agents to assess their ability to perform tasks such as ordering, scheduling, or cancelling meetings.
- Analyze test outcomes, identify issues, and communicate findings for continuous improvement.
- Navigate and understand the Python codebase to correlate test results with underlying code.
- Improve and test existing AI agents.
- Identify where agents perform well and where they fail.
- Prompt testing and tuning to optimize agent responses.
- Flagging test results as pass/fail based on expected behavior.
Technical Skills & Qualifications
- Bachelor’s degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
- 2+ years of experience in research or prototyping within machine learning, deep learning, or natural language processing.
- Proficient in Python, with the ability to understand and work with a codebase containing multiple interrelated files.
- Experience with AI agent frameworks such as Model Context Protocol (MCP) and LangChain.
- Familiarity with architectural patterns of large-scale software systems.
- Basic knowledge of SQL and data analysis is a plus.
- Experience using source control systems (e.g., Git).
- Experience in generative AI and LLM research preferred.
- Python programming
- Generative AI knowledge
- Understanding of MCP servers and LangChain frameworks
About US Tech Solutions
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.
US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Recruiter Details
Email: ajit.kumar@ustechsolutionsinc.com
Job details
- Seniority level: Associate
- Employment type: Contract
- Job function: Research
- Industries: Software Development
#J-18808-Ljbffr