Python Senior Engineer

Python Senior Engineer

12 Month contract initially + Extensions

Based: 2 days p/w onsite in London

Rate – £400 – £500 pay p/d via Umbrella

Key Responsibilities

• Building and evolving AI-powered services using Python
• Designing and implementing evaluation frameworks for LLM-based systems
• Improving output quality through structured evals rather than purely code changes
• Applying techniques such as LLM-as-a-Judge to assess response and recommendation quality
• Working with non-deterministic systems and iterating based on real-world behaviour
• Integrating AI services into a broader platform and API ecosystem
• Contributing to production readiness including reliability, observability, and performance
• Partnering with data scientists on prompts, model usage, and evaluation strategies

Key Skills and Experience

• Strong Python engineering experience in production environments
• Experience building AI-enabled applications, particularly in recommendation or conversational systems
• Hands‑on experience with evaluation frameworks for LLM or AI systems
• Clear understanding of how AI systems differ from traditional deterministic systems
• Ability to design meaningful evals and improve system quality over time
• Experience working in cross‑functional teams with engineering, data, and product

Desirable skills/knowledge/experience

• Experience with Azure AI services or similar platforms
• Familiarity with OpenAI or similar SDKs
• Exposure to infrastructure and distributed systems
• Experience with tools such as Terraform or Kafka

We welcome applications from all individuals, regardless of background or identity, and encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.

#J-18808-Ljbffr…