Microsoft Fabric Data Engineer

Responsibilities:

• Ingestion configuration for new workloads in to Microsoft fabric
• Lead execution of Fabric migration
• Lead and guide migration engineers and QA
• Wring Python/PySpark and Spark SQL code for validation/curation in notebook
• Implement or amend worker pipelines
• Convert logical and conceptual data models into detailed technical data mappings
• Data migration, implementation and execution
• Azure DevOps/GitHub configurations for Microsoft Fabric code

Key skills and experience:

• Strong experience in designing and delivering Azure based data platform solutions technologies including:
  • Microsoft fabric, Power App, Azure SQL, Power BI
  • Azure ADF, Azure Functions Service
  • Spark processing and performance tuning
  • File formats partitioning for e.g. Delta Lake, Parquet, JSON, XML, CSV
  • Azure DevOps/GitHub
• Hands on Python experience
• Experience of synchronous and asynchronous interface approaches
• Knowledge in data modeling (3NF/Dimensional modeling/Data Vault2)
• Able to provide comprehensive documentation
• Able to set and manage realistic expectations for timescales, costs, benefits and measures for success

Nice to have:

• Experience with integration and implementation of data cataloging tools, like Azure Purview and Collabra
• Experience in implementing and integrating visualization tools, like Power BI, Tableau, etc.

#J-18808-Ljbffr…