Get daily remote job opportunities in your inbox

No middlemen, no spam, no infinite scrolling.

Get relevant job opportunities, one email at a time.

Unsubscribe at any time.

Back to Remote jobs  >   Data Analysis
Annotation QA Analyst @Spotify

[Hiring] Annotation QA Analyst @Spotify

Mar 25, 2025 - Spotify is hiring a remote Annotation QA Analyst. 💸 Salary: $82,921 - $118,459 plus equity. 📍Location: USA.

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

The Annotation Platform Ops team works alongside Product and Engineering teams at the heart of the Content Platform R&D studio to develop rich and interconnected datasets to enable delightful consumer experiences through a fusion of machine and human expertise. We focus on use cases across all of Spotify’s verticals - Music, Podcasts, and Audiobooks, with an emphasis on the safety and moderation of our catalogs in accordance with Spotify policies.

We are seeking an Annotation QA Analyst or someone who is interested in making the move into a data analysis role, to contribute their human expert knowledge to the wide collection of labeled datasets that Content Platform teams use to train, evaluate, and better understand our machine learning models.

  • Proactively annotate the catalog and ensure content is in line with Spotify’s standards and policies, including running quality reviews prioritized by business needs.
  • Ensure high-quality and timely results for R&D collaborator teams (Product and Engineering) via established quality framework / quality assurance processes, using metrics such as agreement rates and consensus.
  • Run QA expert reviews on the most difficult edge cases in projects in order to address and resolve any ambiguity.
  • Surface themes, suggestions, and feedback for the annotation team per project. Communicate complex concepts and findings in a clear and effective manner to non-technical and technical audiences.
  • Contribute to feedback loops between annotation teams, R&D collaborator teams (Product and Engineering), content policy experts and/or Trust & Safety policy experts, in order to continuously iterate on data analysis workflows.
  • Collaborate with R&D collaborator teams (Product and Engineering) to ensure proper project guidelines exist per use case prior to annotator training (e.g. ensuring proper in scope vs out of scope examples are generated). If necessary, update or revise project guidelines based on results from initial rounds of annotations.
  • Proactively collaborate with other members of the Annotation Platform Ops team across all in-flight projects.

Qualifications

  • Well-versed in annotation, data analysis, quality assurance, and human-in-the-loop best practices.
  • Comfortable with large-scale review and contributing to very large datasets.
  • Passionate about catalog safety and moderation (e.g. Trust & Safety).
  • Self-starter who can collaborate with cross-functional partners in a dynamic environment and deliver results.
  • Excellent verbal and written communication skills.
  • Good grasp of machine learning lifecycles from goal setting to data collection/labeling to model development and deployment is a plus.
  • Basic knowledge of SQL is a plus.

Requirements

  • This role is based in New York.
  • We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.

Benefits

  • The United States base range for this position is $82,921.00 - $118,459.00 plus equity.
  • Health insurance.
  • Six month paid parental leave.
  • 401(k) retirement plan.
  • Monthly meal allowance.
  • 23 paid days off.
  • 13 paid flexible holidays.

Similar Remote Jobs

More jobs at Spotify

More Data Analysis jobs

More jobs in USA

Kickstart Your Job Search

Need advice to apply? Join our free Webinar « 3 Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) »
Register for free

Unlock 54,098 additional remote jobs, advanced search & email notifications

Get Access Now

Too many emails? Declutter your inbox with Meco

Your home for reading newsletters

Try for free - no card required.
Before You Apply
️
📍 Be aware of the location restriction for this remote position: USA
‼ Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Back to Remote jobs  >   Data Analysis
Annotation QA Analyst @Spotify
Data Analysis
Salary 💸 $82,921 - $118,459 plus equity
Remote Location
USA
Job Type full-time
Posted Mar 25, 2025
Apply for this position Unlock 54,098 Remote Jobs
️
📍 Be aware of the location restriction for this remote position: USA
‼ Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Annotation QA Analyst Apply for this position Unlock 54,098 Remote Jobs
×
  • Unlock 54,098 hidden remote jobs.
  • Your shortcut to remote work. Apply before everyone else.
  • Click and apply. No middlemen, no hassle.
Remotive - Email digest of tips on remote work and productivity | Product Hunt

We’re not like the other sites. Come see why!

50% off in March 2025
  • Single payment
  • Lifetime access
  • Filter by location/skills/salary…
  • Create custom email alerts
  • Private Slack Community

Get relevant job opportunities in your inbox

    Remotive
    Find Remote Jobs
    Hiring Remotely
    Quick Access