Senior Machine Learning Engineer, Personalization, Magenta

Team: Personalization

Location: New York, NY

Workplace Type: remote

What Youll Do

• Youll build and improve the core agentic capabilities that power the agent behind Talk to Spotify (memory, context management, multi-step tool use)
• Youll design and calibrate evaluation frameworks (including LLM-as-judge) that accelerate our confidence in the agents behavior, and increase our offline-to-online success
•  Youll work in a very dynamic space: the team prototypes, dogfoods, ships, learns, and refines in tight loops with real users, as our understanding of the problem and users expectations of agentic products and Spotify evolve

Who You Are

• Youre excited by agentic experiences — building agents, evaluating agents, and the hard problems in between (context handling, multi-step reasoning, ambiguity at scale)
• You like getting your hands dirty: shipping quickly, testing ideas against real usage, and learning from the wild rather than over-indexing on offline evaluation
• You have 5+ years of production ML experience deploying highly impactful products, or equivalent experience in other roles with a deep ML background
• You know how to evaluate ML systems rigorously — designing metrics, building eval pipelines, judge alignment, and can develop intuition through dogfooding and looking at user behavior
• Youre comfortable debugging the messy interactions between models, tools, and system constraints like latency

Where Youll Be

This role is based in New York
We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home

The United States base range for this position is $184,050- $262,928 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future.