The Conversational Shopping team is looking for an AI Language Engineer to drive innovation and scalable solutions as it delivers a delightful AI‑assisted shopping experience. This is an opportunity to join the high‑performing org behind Alexa for Shopping. Our objective is to make it easy for customers to find and discover the best products for their unique needs through recommendations, comparisons, product Q&A, and more. This role is cross‑functional, requiring collaboration across global product, design, science, and engineering teams.
Responsibilities
- Develop LLM‑as‑a‑judge systems to support human‑in‑the‑loop evaluations.
- Automate operations and perform data analysis using scripting languages (e.g. Python).
- Author, optimize, and manage system prompts for customer‑facing LLM systems on mobile and web apps.
- Integrate API calls into Retrieval Augmented Generation (RAG) systems.
- Evaluate model performance and annotation quality to produce reports for stakeholders.
- Produce, process, and manipulate different types of language data.
- Contribute to defining platform requirements for internal tooling by developing prototypes.
- Raise the quality bar on editorial workflows and SOPs through standardization, documentation, and periodic audits and investigations.
- Support processes and mechanisms to onboard and upskill editors and AI tutors on an ongoing basis.
- Design, implement, and refine control mechanisms, metrics, and methodologies to ensure editorial and annotation quality.
- Collaborate with editors, applied scientists, engineers, and product managers to deliver an optimal customer experience by defining metrics, guidelines, and workflows.
- Deliver across parallel workstreams, balancing timelines, impact, and stakeholder requirements.
Qualifications
- Experience with Unix tools, strong analytical skills, attention to detail, and effective communication.
- Experience in a fast‑paced, dynamic organization and the ability to prioritize multiple assignments while maintaining deadlines.
- Master’s degree in Applied Linguistics, Computational Linguistics, Natural Language Processing (NLP) or related field.
- Experience with Large Language Models, NLP, or Machine Learning.
- Experience with Python libraries for data analysis such as pandas and scikit‑learn.
- Familiarity with AI coding assistants.
- PhD in Applied Linguistics, Computational Linguistics, NLP or related technical field (preferred).
- Experience with SQL and Git.
- Experience building RAG or agentic systems.
- Experience conducting quantitative analysis.
- Experience building data pipelines.
- Experience with AWS services (Bedrock, S3, EC2, etc.).
- Knowledge of user experience concepts and methods.
- Familiarity with online retail (e‑commerce).
About the Team
The CMX‑Lang‑Tech team is a technical sub‑team of the AI Shopping Content team. We are responsible for AI response quality both in terms of evaluating and prompting our AI models. This role requires strong analytical and technical skills as well as experience in language technology to help us measure, analyze and solve complex problems.
Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy_page) to learn more about how we collect, use and transfer the personal data of our candidates.
#J-18808-Ljbffr…