Do not worry if the skill set is not an exact match I would still like to hear from you!
Job Title: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform)
Location: Edinburgh (hybrid/ 2 days a week)
Circa: 575 GBP/Day inside IR35 - no VISA sponsorship available
Duration: 6 months initially (TBC)
Start: ASAP
Role Overview
We are seeking an experienced GCP Data Engineer with strong expertise in DBT, Cloud Composer, Python, and Terraform. This role will focus on migrating legacy data platforms and regulatory use cases (e.g., risk, finance, RWA) to GCP, while actively contributing to design and development.
Key Responsibilities
- Lead the design, development, and deployment of data pipelines on GCP.
- Drive migration of legacy data platforms and use cases to GCP, ensuring minimal disruption and optimal performance.
- Build and manage data transformation workflows using DBT.
- Orchestrate pipelines using Cloud Composer (Apache Airflow).
Required Skills & Experience
- Strong hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.).
- Proven experience in DBT for data transformation.
- Expertise in Cloud Composer / Apache Airflow for workflow orchestration.
- Advanced proficiency in Python.
- Solid experience with Terraform for infrastructure provisioning.
- Demonstrated experience in migrating legacy systems (on-prem or other cloud) to GCP.
Preferred Qualifications
- Experience in large-scale data transformation programs.
- Familiarity with CI/CD pipelines and DevOps practices.
- Exposure to data governance and regulatory environments (e.g., banking/financial services).