Data Fabric Engineer – SC Cleared
Our client is looking for Data Fabric Engineers. You will have strong experience with MS Azure Fabric within a public sector or government data environment.
Skills required:
· Azure Data Factory (ADF) for orchestration and data movement
Lakehouses, Data Pipelines, Dataflows Gen2, Fabric Notebooks)
· PySpark, SQL, and Python for large-scale data transformation
· Delta Lake, Apache Spark, and OneLake architecture
· Good knowledge of Microsoft Purview for data governance, cataloguing, and lineage
· Azure DevOps, Git-based version control, and CI/CD pipelines
· Good understanding of data lakehouse architecture
· Experience with Azure Synapse Analytics or migration from Synapse to Fabric
· Familiarity with Databricks or equivalent distributed processing platforms
· Experience in UK public sector or government data environments
· Understanding of SC clearance requirements and government security classifications
· Knowledge of DDAT frameworks and GDS delivery standards
· Good knowledge of Azure storage services (ADLS Gen2, Azure Blob Storage)
The position is based remotely. The contract is inside IR35 for 6 months.
To be considered for the position please forward your CV over.
…