Direct message the job poster from Stealth iT Consulting
Delivery Consultant | Contracts | Public Sector | Digital & Cloud | Technology | GDS | Government Roles | Security Clearance
Job Title: Data Engineer
Location: Remote with onsite visits to Swansea (2 days per week). Travel will be expensed
Clearance: Active SC
Responsibilities
- Build and maintain robust, scalable data pipelines in Databricks in alignment with data modelling and architecture principles as directed by the client's head of data
- Ensure data quality, consistency, and lineage across all data sources and destinations
- Implement and manage orchestration, scheduling, and monitoring of data pipelines
- Collaborate with members of the client's data team to ensure solutions are aligned to target architecture and best practices
- Maintain technical documentation for data pipelines, jobs, and integrations
- Support and develop junior members of the team
Mandatory Skills
- Use of Databricks DLTs
- SQL
- SSIS Packages
- Python
- PySpark
Recommended Skills
- AWS
- Deep understanding of data modelling
- Strong grasp of CI/CD, version control, and DevOps practices for data.
- Experience with data quality, testing, and observability tooling.
- Experience with JIRA and Confluence
Additional Information
Seniority level: Mid-Senior level
Employment type: Full-time
Job function: Information Technology
Industries: Business Consulting and Services, Public Relations and Communications Services, IT Services and IT Consulting
Referrals increase your chances of interviewing at Stealth iT Consulting by 2x
#J-18808-Ljbffr