The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we're behind some of Spotify's most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and you'll keep millions of users listening by making great recommendations to each and every one of them.
The Experimentation and Learning team (SEAL) sits within the Surfaces Foundation product area in the Personalization mission. This team builds the experimentation and learning infrastructure for Spotify Surfaces — powering how we test, evaluate, and ship personalized experiences across Home and beyond. By creating a unified, agent-driven experimentation ecosystem, we enable teams to go from a raw hypothesis to a fully configured, running experiment in minutes instead of days.
What You'll Do
- Own and evolve the core experimentation service, building agentic workflows that automate experiment setup, configuration, and validation across multiple backend systems
- Design and maintain API-first orchestration layers that coordinate across experimentation and content delivery systems
- Build and integrate LLM-driven workflows into robust, production-ready infrastructure, including planner, generator, and validator architectural patterns
- Define and uphold SLOs and SLAs for experimentation infrastructure, contributing to a strong culture of reliability and operational excellence
- Partner closely with content, feature, and platform teams to scale automated experimentation patterns across a growing range of surfaces and configurations
- Identify, diagnose, and resolve bottlenecks in experiment orchestration to ensure fast and reliable workflows
- Collaborate across squads to continuously improve how experimentation and evaluation are delivered across Spotify Surfaces
- Contribute to architectural decisions that improve system scalability, observability, and maintainability
Who You Are
- You have experience building and operating large-scale backend systems serving high-traffic user experiences
- You’re comfortable using AI-assisted tools to develop high quality software.
- You are experienced with distributed systems, APIs, and service-oriented architecture
- You know how to design systems with performance, scalability, and reliability in mind
- You are a product-minded engineer who thrives at the intersection of infrastructure, AI, and experimentation
- Experience translating conceptual architectures into scalable, production-ready code
- Comfortable working across multiple teams and collaborating with cross-functional partners
- You care about creating maintainable systems that enable fast iteration and experimentation
- Motivated by turning fragmented, manual processes into elegant, automated workflows
- Experience defining and working with SLOs, SLAs, and observability tooling
- Experience with LLMs, agent frameworks, or A/B testing infrastructure is a bonus
Where You'll Be
- We offer you the flexibility to work where you work best! For this role, you can be within the North America region as long as we have a work location.
- This team operates within the Eastern Standard time zone for collaboration.
Similar Jobs
What you need to know about the Colorado Tech Scene
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute


