You will be responsible for:
- Joining each and every one of your colleagues in creating an inclusive workspace;
- Owning, maintaining, and supporting the reliability, architecture, and evolution of our production machine learning and delivery platform;
- Designing, operating, and improving large scale Databricks/Spark pipelines and workflows
- Partner with our data scientists to productionize new data and ML-powered products;
- Leading improvements on the software integration layers between data pipelines and product workflows;
- Growing the team via mentorship and leadership, reviewing technical documents, improving code quality, and improving team performance and processes;
- Acting as a senior technical owner in debugging complex production issues and improving system observability;
- Collaborating with cross-functional teams to support their data infrastructure needs.
Must-have qualifications:
- Extensive hands-on software engineering experience, with a strong track record of delivering production data pipelines or platforms in a mission critical environment
- Strong experience with Python in production systems
- Experience integrating ML models into reliable production data pipelines, including batch inference and model serving patterns
- Experience building and operating Databricks (or Spark) based pipelines
- Experience with SQL
- Experience with at least one major cloud infrastructure provider (GCP, AWS, Azure)
- Experience with supporting business-critical systems with on-call ownership
- Passion, energy, and excitement for progressive and philanthropic causes and all things digital.
Nice-to-have qualifications:
- 5+ years of professional experience;
- Experience building data-intensive applications and warehouses with Databricks;
- Experience with integrating production level applications with AWS;
- Experience supporting ML training or inference pipelines;
- Experience working with cross-functional teams in a dynamic environment.
#J-18808-Ljbffr…
