Staff Software Engineer, AI Serving (AI Infrastructure)
Engineering
Flex - London, United Kingdom
POS-22139
This role can be Office/Hybrid/Remote based within the UK
HubSpot is on the forefront of empowering businesses with cutting‑edge AI, and our AI Infrastructure group is at the heart of this initiative. We are seeking a Staff‑level Software Engineer with a passion for infrastructure and developer experience to join our AI Serving team. The AI Serving team is part of AI Infrastructure and its goal is to own and operate HubSpot's model inference and serving infrastructure end‑to‑end, ensuring AI models are reliably deployed, scaled, observed, and cost‑efficient across all hublets and environments, while also serving as the home for modern Python at HubSpot.
The team owns the serving frameworks and libraries that power synchronous, asynchronous, and offline inference, along with model deployment pipelines, autoscaling, and GPU/CPU resource management. The team's roadmap focuses on improving the reliability and efficiency of batch inference, strengthening model observability, and scaling AI infrastructure cost‑effectively. The team also serves as the home for core Python libraries and tooling across HubSpot.
As a Staff Software Engineer on the AI Serving team you will:
- Write and ship production code that directly powers AI capabilities across HubSpot, a crucial building block for user and business impact at scale.
- Lead the evolution of our model serving and inference infrastructure, improving reliability, scalability, and cost‑efficiency.
- Set technical direction for how HubSpot deploys and operates ML models at scale, guiding decisions on architecture, cost optimization, and developer experience.
- Work closely with Machine Learning Engineers, Product Software Engineers, and other Infrastructure teams to streamline model deployment and serving.
- Gain deep exposure to a wide range of HubSpot infrastructure systems through building and maintaining core Python libraries, an excellent opportunity to learn how HubSpot operates under the hood.
- Collaborate with HubSpotters all over the company, whether in engineering, product, design, research, marketing, sales, etc., gaining exposure to how HubSpot works as a business.
- Be empowered to show up as your authentic self and choose a work style and location where you can do your best work, whether that’s at home, in an office, or a blend of the two.
What we'd like to see:
- A proven track record of directly contributing to and leading infrastructure projects at scale, ideally in serving, deployment, or platform engineering.
- The ability to work collaboratively with the team to solve problems, transfer knowledge, and develop overall platform architecture.
- The ability to work effectively across teams, driving technical initiatives spanning multiple groups within AI Infrastructure and beyond.
- Comfort with ambiguity: you can take on broad, cross‑team problems and drive them to resolution without waiting for every detail to be specified.
- Coaching and mentorship experience.
- A track record in partnering successfully with recruiting to build remarkable engineering teams.
- Bonus: Python expertise. Experience with Python tooling, libraries, and developer experience is a strong plus, given the team's role in stewarding Python across AI workloads at HubSpot.
We know the confidence gap and impostor syndrome can get in the way of meeting spectacular candidates, so please don’t hesitate to apply — we’d love to hear from you.
If you need accommodations or assistance due to a disability, please reach out to us using this form.
Equal Opportunity Statements
Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Germany Applicants: (m/f/d) - link to HubSpot's Career Diversity page.
India Applicants: link to HubSpot India's equal opportunity policy.
#J-18808-Ljbffr