Principal Data Engineer (Azure)
We are seeking a Principal Data Engineer to join our Business Analytics team and lead the development of our cloud‑based data platform.
The platform is built on an Azure lakehouse architecture using Fabric and Azure Databricks, providing a secure, governed and trusted foundation for data, enabling the development, deployment and scaling of data products and AI/ML solutions.
Role Overview
As Principal Data Engineer, you will be the senior technical authority for data engineering in our organisation, setting standards and technical direction for the practice without direct line‑management duties.
Responsibilities
- Own and evolve data engineering standards and guiding technical principles across the Azure data analytics estate.
- Gatekeep pull requests in Azure DevOps for changes to production data pipelines.
- Lead the research and development of new tools, patterns and platform capabilities within the analytics environment.
- Design and assure technical designs for all projects on the Analytics platform.
- Undertake hands‑on development for proof‑of‑concept work and complex technical initiatives.
- Collaborate with analytics, data science, architecture and platform teams, as well as the Platform Product Owner and Technical Support Team Lead, to transition established solutions into support.
- Act as the key technical liaison with external digital partners, ensuring alignment and providing technical assurance on joint initiatives.
Qualifications
Essential skills and experience
- Extensive hands‑on experience as a senior or principal Data Engineer on Microsoft Azure.
- Strong experience of modern Azure data platforms such as Azure Data Lake, Microsoft Fabric and Databricks.
- Proven ability to design and build scalable, secure data pipelines and lakehouse architectures.
- Strong programming skills in Python and SQL; Spark experience desirable.
- Experience working within DevOps CI/CD environments using Azure DevOps.
- Solid understanding of data quality, security and governance in regulated environments.
- Excellent communication skills and ability to influence through technical expertise.
Desirable
- Experience with streaming or IoT data.
- Familiarity with Infrastructure as Code (Terraform or Bicep).
- Azure certifications.
Benefits
- Full‑time role (35 hours per week) with 38 days of holiday per year, plus the option to purchase five additional days.
- Paid time off to volunteer in the community.
- Hybrid flexible working arrangements.
- Pension scheme.
- Life assurance.
- Annual company bonus and access to a rewards programme.
Compensation & Application
This role is Grade 8. Starting salary £54,776 with performance‑driven progression up to £74,386.
Applications accepted until midnight on 3rd June 2026.
Applicants must be Scottish residents or be willing to relocate to Scotland within three months.
Safety & Compliance
Drug & Alcohol testing may be required in line with company policy.
#J-18808-Ljbffr…