Job IntroductionWe are looking for a Data Engineer to design, build and maintain a scalable on‑premise data warehouse using modern data engineering practices. You will work with Python, Apache Airflow and DBT in a Unix/Linux environment to develop robust data pipelines, transform data into curated models and support analytics and reporting. This role requires someone comfortable working in a non‑cloud (on‑prem) environment, with a strong ownership of infrastructure‑aware data solutions.
Main Responsibilities
- Design and build end‑to‑end ETL/ELT pipelines using Python and SQL.
- Develop and orchestrate workflows using Apache Airflow.
- Implement transformation logic and data models using dbt (medallion/star where applicable).
- Work in a Unix/Linux environment for scheduling, scripting and deployment.
- Maintain CI/CD pipelines and version control.
- Translate complex business requirements into clear technical specifications.
- Administer, maintain and provide support for data analytics platforms.
- Build and maintain solutions across the Microsoft BI stack (SSRS, SSIS, SSAS, T‑SQL).
- Perform unit testing and resolve issues through effective troubleshooting.
- Collaborate with cross‑functional teams to ensure seamless system integration.
- Deliver insightful visualisations and reports to support business projects.
- Create, maintain and update comprehensive technical documentation.
- Operate in line with the Bank’s Risk Management framework and relevant policies and procedures, ensuring timely and appropriate escalation of concerns to relevant stakeholders.
Ideal Candidate
Strong programming skills in Python (data pipelines, APIs and scripting). Hands‑on experience with Apache Airflow, configuring, maintaining and optimizing DAGs. Strong experience with dbt (models, macros, tests and documentation). Exposure to containerisation (Docker). Knowledge and experience of ETL/ELT, data warehousing, BI and Cloud. Advanced SQL (T‑SQL or PL/SQL). Good understanding of Linux/Unix systems. Design, develop and maintain solutions using Microsoft BI stack (SSRS, SSIS, SSAS, T‑SQL). Experience with agile delivery, test automation and CI/CD. Skilled at developing dashboards and data visualisations in tools such as PowerBI, Tableau, Qlik, etc.
We encourage candidates who may not meet all criteria; if you are unsure, please get in touch anyway.
The Bank is deeply committed to embedding good equality and diversity practice into all of our activities. We are an inclusive, welcoming and inspiring place to work that encourages everyone to apply, regardless of socio‑economic background, age, disability, pregnancy and/or parental status, race, ethnicity, nationality and other protected characteristics.
#J-18808-Ljbffr…