Alvarium Talent is partnering with a fast-growing, independent Data and AI consultancy that specialises in delivering cutting-edge analytics, cloud data platforms, and AI solutions to enterprise clients across multiple sectors. Due to continued growth and demand for Databricks expertise, we are hiring a Databricks Architect to lead the design and delivery of modern Lakehouse architectures.
Role Purpose
As a Databricks Architect, you will play a pivotal role in shaping and delivering scalable, enterprise-grade data architectures using the Databricks Lakehouse platform. Acting as both a trusted advisor and hands-on technical leader, you will work closely with clients to translate business requirements into robust, secure, and high-performing data solutions. You’ll contribute to both delivery and pre-sales, influencing data strategy while ensuring best practices in governance, performance, and cost optimisation are embedded from day one.
Core Responsibilities
- Architect and deliver Databricks Lakehouse solutions across ingestion, transformation, and analytics layers
- Design scalable data platforms supporting AI, ML, and business intelligence use cases
- Engage stakeholders to gather requirements and present architectural decisions
- Lead end-to-end solution delivery, ensuring quality, performance, and security standards
- Optimise Databricks environments for cost efficiency and scalability
- Implement data governance frameworks, including lineage, cataloguing (Unity Catalog/Purview), and security
- Develop and maintain CI/CD pipelines using Azure DevOps, GitHub, or similar tools
- Support pre-sales activities including RFP responses, solution design, and Proofs of Concept (PoCs)
- Advocate best practices and contribute to reusable architecture frameworks
Role Requirements
Essential
- Proven experience designing and delivering Databricks Lakehouse architectures at enterprise scale
- Strong hands-on expertise in Spark, PySpark, SQL, and Python or Scala
- Deep understanding of data modelling (Kimball, Data Vault, 3NF)
- Experience building ETL pipelines using Databricks workflows and Delta Live Tables
- Cloud platform experience (Azure preferred, AWS or GCP acceptable)
- Experience implementing data governance, security (RBAC/IAM), and compliance frameworks
- Exposure to BI tools such as Power BI or Tableau
- Strong stakeholder management and client-facing consulting experience
Desirable
- Experience with Unity Catalog or Microsoft Purview
- Knowledge of ML/AI capabilities within Databricks (MLflow, AutoML)
- Experience with Infrastructure as Code (Terraform, ARM templates)
- Strong understanding of DevOps and CI/CD practices
- Databricks certifications (Data Engineer, ML, Lakehouse, or GenAI)
Why Apply
- Work with a high-growth consultancy at the forefront of Data & AI innovation
- Deliver cutting-edge Databricks and Lakehouse solutions across diverse industries
- Opportunity to influence enterprise data strategies and transformation programmes
- Strong emphasis on career progression, certifications, and continuous learning
- Collaborative, people-first culture with high levels of autonomy and impact
…