Key Responsibilities
- Design, develop, and implement scalable data lake solutions.
- Build and maintain robust data cataloging systems for improved data discoverability and governance.
- Optimize data pipelines for performance, reliability, and cost-efficiency.
- Collaborate with data scientists and analysts to understand their data needs and provide solutions.
- Ensure data quality, security, and compliance across the data platform.
- Troubleshoot and resolve issues related to data infrastructure and pipelines.
Requirements
- Proven experience as a Data Engineer or in a similar role focusing on data platforms.
- Strong understanding of data lake architectures and data cataloging principles.
- Proficiency with cloud platforms, particularly AWS services (e.g., S3, Glue, EMR).
- Hands‑on experience with big data technologies like Spark and distributed systems.
- Expertise in SQL and data modeling techniques.
#J-18808-Ljbffr…
