As the Senior Data Platform Engineer in the Cyber Data Platform team, you will play a key role in building and maintaining a robust data platform that enables users to develop advanced analytics, machine learning, and GenAI solutions to strengthen our security defences. You will collaborate closely with cross‑functional data teams to ensure the platform is scalable, secure, and aligned with cybersecurity goals. Also, you will contribute to the data platform architecture and mentor junior team members to deliver high‑quality data services.
Responsibilities and Qualifications
- Design, build and manage realtime, near realtime and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.
- Implement and manage automated frameworks for integrating data from various security sources into the security data lake, and for moving data between raw, trusted and curated data layers.
- Produce high‑quality code, conduct thorough peer reviews and provide constructive feedback.
- Implement automations and DevOps practices to streamline deployment, configuration and management of data platform components.
- Effectively communicate technical concepts and solutions to individuals with varying technical expertise across departments.
- Solid experience with Python and proficiency in SQL.
- Experience building data platforms on cloud services such as Databricks on Azure or GCP BigQuery, and big data technologies like Spark or Flink.
- Solid grasp of Kubernetes, CI/CD and Terraform.
- Working knowledge of ETL and ELT frameworks and orchestration tools such as Airflow and dbt.
- Ability to provide clear input, guide and empower junior team members to achieve desired outcomes.
- Familiarity with machine learning and AI tools is desirable. Knowledge of cybersecurity principles and practices.
Equal Opportunity
We’re proud to be an accredited Disability Confident Leader, where everyone’s welcome. We commit to providing a fully inclusive and accessible recruitment process. If you need support with your application, click here for more information. And if you’re interested in joining our team but don’t tick every box, don’t let that hold you back from applying.
#J-18808-Ljbffr…