Backend/Data Engineer - Data Processing

Job Description

The Data Processing teams enable Spotify to solve sophisticated and critical data engineering problems by providing a platform and tooling for the production, management and consumption of high-quality data. We are an amplifier for efficiency, quality, and innovation across Spotify. We are looking for a backend/data engineer to help us increase efficiency, optionality and flexibility for data practitioners through scalable, portable and reliable data processing platforms, all while maintaining our global cloud cost efficiency.

What You'll Do

• You’ll collaborate with product and engineering to build and support the infrastructure that empowers Spotify teams to process data to tackle critical business needs
• Increase developer efficiency by building innovative tools that reduce overhead of working with data pipelines, help increase platform reliability, and are cost-efficient
• Work with engineers with deep expertise in data and collaborate closely with squads in Spotify to drive improvements in the data processing ecosystem through support, best-practices and standards
• Help scales the new platform to reach targets that ensure the painless and flawless migration of data pipelines from all across the company to the new stack
• You love working in an environment where you constantly experiment and iterate quickly and believe data is the most powerful tool for informed decision-making

Who You Are

• You are proficient in backend development using Java
• You are comfortable working with big data using SQL and data analytics platforms such as BigQuery
• You have experience with one or more higher-level JVM-based data processing frameworks such as Flink, Beam, Dataflow, Spark, etc.
• DevOps is part of your day-to-day work and you are used to working with cloud-based infrastructure and services, containerised applications
• You have some experience working with Kubernetes and are familiar with its basic concepts
• You have experience working with data engineering pipelines in Scala and/or Python
• Quality is important to you and you know what it means to ship high-quality code
• You appreciate agile software processes, and sound engineering practices like continuous delivery, defensive programming, and automated testing
• You love working in an environment where you experiment and iterate quickly. You are comfortable with ambiguity, enjoy working on open-ended problems, and believe data is the most powerful tool for informed decision-making!

Where You'll Be

• For this role you will be based in London, UK

Apply for this job