Data Engineer

Wed all like amazing work to do, and real work-life balance. Thats waiting for you at Sainsburys. Think about the scale it takes to feed the nation. The level of data, transactions and variety involved. Then youll realise this is a modern software engineering environment, because it has to be. Weve made significant investment in the standards and principles that shape how we work. We iterate, learn, experiment and champion ways of working such as Agile, Scrum and XP. So you can look forward to exciting opportunities across everything from AI to reusable tech.Were a multi-channel, multi-brand business serving millions of customers a day, with the UKs largest loyalty scheme and an ever-evolving set of digital platforms. All of this equals over 1.2 billion transactions each year, presenting a volume, depth and complexity of data that few can match.We dont think were exaggerating when we say we have the most exciting data set in the country. And from the insights gained, we build scalable, high-performance products using cutting-edge technology that give our customers an amazing shopping experience like our award-winning Smartshop app. In an inclusive, agile environment, youll have the space to be curious, to experiment, and to solve real-world challenges. And youll get to see your creations in the hands of millions of people across the UK.As a Data Engineer, youll be part of one of our data engineering teams, applying architectural and engineering principles to define and deliver technology that will better customer experiences, improve efficiency and reduce business costs, helping us to lower prices. Youll support your team by enabling performance, compliance and risk management by sharing your expertise, judgement and passion for delivering quality products for customers.In the role, youll contribute to the design and development of real-time analytics for our sales data. Youll use Python, SQL and Java (17+) with tools and frameworks like Spring Boot, Maven and Docker to create stream processors on Kafka topics, running on Kubernetes clusters, and data pipelines in Snowflake.We use a variety of tech here and you need to be willing to pick up new tools and techniques. Wed also like you to be yourself analytical, curious and unafraid to challenge the status quo.Youll be a role model for best practices, championing a customer centric mindset and a passion for finding creative ways to solve problems, mentoring fellow engineers as a progressive member of the engineering community.More about the roleYoull contribute to the design and development of large-scale high performance streaming pipelines for our sales data using Python, SQL, Java (17+) with tools and frameworks like Snowflake, Confluent Kafka, Kafka Streams, Spring Boot, Maven and Docker.Youll contribute to the implementation of cloud and container technologies such as Kubernetes on AWS.Youll contribute to the design and support of services and internal frameworks that enhance Sainsburys capabilities.Youll guide, support and enable performance within the team through providing technical knowledge and ideas.About youProven experience of software design and implementation, security, cloud, infrastructure as code and CI/CD and any relevant hardware.Self-drive and constantly striving to improve your team, division and peers.Drive for advocacy of agile/lean delivery methodologies.A passion for delivering solutions to customers and living the DevSecOps principles.A passion for enhancing your knowledge and evidence curiosity in emerging tech.Display empathy and understanding in supporting colleagues in the team to deliver.An interest in learning about Java and Kafka, and real-time data pipelines.Proficiency in engineering practice, including knowledge of engineering and architectural principles.Essential CriteriaExperience building ETL Pipelines with Airflow, Python and SQL.Experience with raw data vault and star schema modelling.Data warehousing experience, especially with Snowflake.Experience working within data analytics teams.Nice-to-havesPossess programming language proficiency in Java.Possess proficiency in streaming data pipelines with Kafka.As well as lots of on-the-job training and endless opportunities, youll get:Colleague discount across our multi-brands Sainsburys, Argos and Habitat.10% side project/personal development time.Generous holiday allowance, with holiday buying scheme.Bonus scheme up to 10% of base salary.Pension plan.Special offers on gym memberships, restaurants, holidays, retail vouchers and more.Work-life balance is important to us, so we offer our colleagues as much flexibility as possible in line with the needs of their role. We trust them to decide how, where and when they work, combining remote and collaborative working with a flexible approach to hours, giving them plenty of time and space for life outside of work whilst delivering against our business goals.We are committed to being a truly inclusive retailer, so youll be welcomed whoever you are and wherever you work. Around here, theres always the chance to try something new-whether thats as part of an evolving team or somewhere else across the business – and we take development seriously and promise to support you. We also recognise and celebrate colleagues when they go the extra mile and, where possible, offer flexible working. When you join our team, well also offer you an amazing range of benefits. Here are some of them:Starting off with colleague discount, you’ll be able to get 10% off at Sainsbury’s, Argos, TU and Habitat after 4 weeks. This increases to 15% off at Sainsburys every Friday and Saturday and 15% off at Argos every pay day. We’ve also got you covered for your future with our pensions scheme and life cover. You’ll also be able to share in our success as you may be eligible for a performance-related bonus of up to 10% of salary, depending on how we perform.Your wellbeing is important to us too. You’ll receive an annual holiday allowance, and you can buy additional holiday. We also offer other benefits that will help your money go further such as season ticket loans, cycle to work scheme, health cash plans, pay advance (where you can access some of your pay before pay day) as well access to a great range of discounts from hundreds of other retailers. And if you ever need it there is also an employee assistance programme.Moments that matter are as important to us as they are to you which is why we give up to 26 weeks pay for maternity or adoption leave and up to 4 weeks pay for paternity leave.Please see www.sainsburys.jobs for a range of our benefits (note, length of service and eligibility criteria may apply)….