Senior Software Engineer, Web-Scale Crawling & AI Search

Company: Nebius
Apply for the Senior Software Engineer, Web-Scale Crawling & AI Search
Location: London
Job Description:

Nebius is building a full-stack AI cloud platform and a novel search engine. We seek a Senior Software Engineer to work on the content acquisition and crawling infrastructure, discovering, fetching, and refreshing data from the open web at scale.

You will design distributed crawling, scheduling, and ingestion systems for billions of URLs, balancing coverage, freshness, and cost while collaborating with indexing and ML teams to meet retrieval and ranking requirements.

#J-18808-Ljbffr…

Posted: July 17th, 2026