Overview
Data Engineers are needed for an Energy trading house, active in both the physical & derivative Trading markets. Specialising in providing flexible energy supply, trading, risk management, and decarbonisation solutions for large energy users. Operating at the intersection of energy markets, technology, and sustainability, the company combines in-house trading expertise, data-driven analytics, and innovative energy solutions to help customers navigate complex wholesale markets and accelerate the transition to a low-carbon future. As a company they are moving to a Data-Centric decision making model and therefore this is an opportunity for a Data Engineer to get involved in the growing Data Engineering team, building scalable data applications, lakes & infrastructure, using Open-source technologies.
Hybrid role with 2-3 days per week in the office in Shepherd’s Bush / Barons Court, West London.
Responsibilities
- Design, develop and maintain data ingestion pipelines using open-source frameworks.
- Build and optimise ELT/ETL processes to handle small to large scale data processing requirements.
- Design and implement scalable data architectures, data lakes, and related infrastructure.
Qualifications
- Experience in complex query optimization.
- Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark).
- Hands-on experience building and maintaining data ingestion pipelines.
- Proven track record of optimising queries, code, and system performance.
- Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow).
Location & Environment
Hybrid, London-based role.
#J-18808-Ljbffr…