CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025.
We’re proud to be a Living Wage accredited Employer.
What You’ll Do:
The Monolith AI Platform Engineering Team at CoreWeave is responsible for building and scaling the data and workflow backbone that powers the world’s most advanced engineering simulation and AI workflows — our ambition is to become the super‑intelligent AI test lab for the engineering industry, helping customers ship science, faster. From high‑throughput data ingestion and feature pipelines to model training and real‑time inference, our platform delivers the performant, reliable, and trustworthy data foundation trusted by the world’s largest engineering companies.
The Staff Data Engineer will own and evolve Monolith’s platform data services and ETL offerings — the data onboarding, preparation, and lineage capabilities that turn fragmented, real‑world engineering data into production‑ready training and inference pipelines. You’ll partner with Product, Engineering, and Customer‑facing teams to deeply understand client data challenges and translate them into scalable, self‑serve data platform features.
About the Role:
We’re seeking a Staff Data Engineer who can own Monolith’s data platform surface end‑to‑end: from offline batch pipelines and large historical backfills to low‑latency, real‑time streaming data flows that power online inference and feedback loops. You’ll define and drive our data architecture, champion data quality and lineage, and decide how customer data moves through Monolith from raw ingestion to governed, observable, and reproducible training sets.
You’ll primarily work with internal teams (Product, Customer Success, Forward‑Deployed Engineers, Software Engineers, Data Scientists), and step in as a domain expert when clients need deeper guidance.
In this role, you will:
- Own Monolith’s Data Platform & ETL Surface
- Lead the architecture and evolution of core data services for ingestion, transformation, validation, and lineage across training and inference workloads.
- Design and maintain end‑to‑end data models and schemas that make complex engineering, simulation, and telemetry data discoverable, reusable, and performant.
- Define standards, contracts, and APIs for how product teams and integrations interact with data services.
- Design & Operate Batch + Streaming Pipelines
- Build and operate batch pipelines for large‑scale historical imports, retraining data sets, and migrations from legacy environments.
- Design and implement streaming pipelines (e.g., using Kafka or similar technologies) for event‑driven or real‑time ingestion and transformation that support online inference, monitoring, and feedback loops.
- Select and integrate off‑the‑shelf, industry‑proven ETL / ELT technologies and own their rollout and long‑term operation.
- Champion Data Lineage, Governance & DataOps
- Implement and maintain end‑to‑end data lineage from source systems to derived features and model artifacts, enabling reproducibility, compliance, and faster debugging.
- Establish DataOps practices: CI/CD for pipelines, observability (metrics, logs, traces), and operational runbooks for data incidents.
- Help define data quality and governance standards in partnership with Security, Compliance, and Customer Success, including support for privacy and regulatory needs.
- Partner Across Monolith & CoreWeave
- Work with Monolith product and engineering teams to expose data services that unlock new user workflows and AI capabilities.
- Collaborate with CoreWeave infrastructure and AI platform teams to leverage storage, compute, and observability for reliable data flows.
- Serve as a technical escalation point for forward‑deployed and customer‑facing engineers when questions go deeper than playbooks.
Who You Are:
- Experience & Level
- 8+ years as a Data Engineer / Data Platform Engineer (or similar), owning production data pipelines and architectural decisions.
- Staff‑level impact: leading critical data domains and cross‑team initiatives.
- Data Engineering & Architecture
- Deep experience designing end‑to‑end data architectures covering ingestion, storage, transformation, serving, and observability.
- Hands‑on experience with both batch and streaming pipelines: batch (historical backfills, retraining) and streaming (Kafka or similar, low‑latency consumption).
- Proficiency with SQL and at least one major analytical database or data warehouse (PostgreSQL or similar), including schema design and performance tuning.
- Proficiency with Spark or Ray or similar distributed data processing frameworks.
- Solid understanding of data modeling (event logs, star schemas, feature tables) in multi‑tenant SaaS or platform contexts.
- Tooling & Ecosystem
- Hands‑on with data orchestration and ETL tooling (Airflow, dbt, Dagster, Temporal, or equivalents) and able to evaluate and recommend tools that fit our needs.
- Experience integrating and operating off‑the‑shelf data infrastructure, including rollout, migration plans, and ongoing ownership.
- Familiarity with cloud infrastructure and containerization (Docker, Kubernetes, at least one major cloud provider) for deploying and scaling data workloads.
- Data Lineage, Quality & DataOps
- Extensive experience implementing data lineage solutions for debugging, compliance, and auditability.
- Strong background in data quality: validation frameworks, monitoring, and guardrails that prevent bad data downstream.
- Proficiency with DevOps / DataOps practices: infra‑as‑code, CI/CD for pipelines, runbooks, on‑call incident response for data issues.
- Programming, Systems & Communication
- Strong programming skills in Python for building data services, transformations, and platform integrations.
- Comfortable working in service‑oriented architectures, reasoning about data contracts, SLAs, and failure modes across services.
- Clear written and verbal communicator able to explain data architectures and trade‑offs to internal stakeholders and occasionally client conversations.
- Preferred
- Experience in ML/AI platforms or MLOps environments where data pipelines feed experimentation, training, and inference workflows at scale.
- Background with time‑series, simulation, or experimental data (physical test benches, sensors, engineering simulations).
- Familiarity with feature stores, experiment tracking systems, or model registries and their integration with upstream pipelines.
- Experience designing data systems for regulated or safety‑critical domains, including privacy, residency, and retention considerations.
What We Offer
- Family‑level Medical Insurance
- Family‑level Dental Insurance
- Generous Pension Contribution
- Life Assurance at 4x Salary
- Critical Illness Cover
- Employee Assistance Programme
- Tuition Reimbursement
- Work culture focused on innovative disruption
Our Workplace
While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration.
CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.
To fulfil our obligation to protect client data, successful applicants offered employment with CoreWeave will be required to complete a basic criminal record check, conducted in compliance with GDPR. Employment offers are conditional upon receiving satisfactory check results.
#J-18808-Ljbffr…