[Hiring] Senior Software Engineer, Machine Learning @AssemblyAI

Role Description

We’re looking for a Senior Machine Learning Engineer to accelerate our AI research-to-production pipeline. You’ll build and improve the infrastructure that enables our research team to rapidly deploy and safely test new models, while helping ensure our production inference systems remain efficient, scalable, and reliable. You’ll identify gaps and opportunities in our ML infrastructure, scope solutions to ambiguous technical problems, and help set the technical direction for how we bridge research innovation and production reliability.

• Design and implement tooling that enables researchers to quickly deploy and evaluate new models in production
• Design, build, and maintain high-performance, cost-efficient inference pipelines, making architectural decisions about scaling, reliability, and cost trade-offs
• Proactively identify and resolve infrastructure bottlenecks, proposing and scoping improvements to iteration speed and production reliability
• Develop and maintain user-facing APIs that interact with our ML systems
• Implement comprehensive observability solutions to monitor model performance and system health
• Troubleshoot and lead resolution of complex production issues across distributed systems, driving root-cause analysis and implementing preventive measures
• Set the direction for and continuously improve our MLOps practices, identifying the highest-impact opportunities to reduce friction between research and production
• Collaborate closely with research and engineering teams to align on technical direction, and help onboard and mentor engineers on ML infrastructure best practices

Qualifications

• Strong backend engineering experience with Python
• Experience building and operating distributed, containerized applications, preferably on AWS
• Proficiency implementing observability solutions (monitoring, logging, alerting, tracing) for production systems
• Ability to design and implement resilient, scalable architectures
• Track record of independently scoping and delivering complex technical projects from problem identification through production deployment
• Comfort navigating ambiguity and making pragmatic technical decisions when requirements are unclear or evolving

Requirements

• MLOps experience, including familiarity with PyTorch and Kubernetes
• Experience working in fast-paced environments where you owned technical direction for an area and drove projects with minimal oversight
• Experience collaborating with remote, globally distributed teams
• Comfort working across the entire ML lifecycle from model serving to API development
• Experience in audio-related domains (ASR, TTS, or other domains involving audio processing)
• Experience with other cloud providers
• Familiarity with Bazel and monorepos
• Experience with alternative ML inference frameworks beyond PyTorch
• Experience with other programming languages
• Experience mentoring junior engineers or onboarding teammates onto complex systems

Benefits

• Salary range: $195,000 - $225,000

Company Description

AssemblyAI builds the best-in-class Speech AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billion+ end-user experiences—from voice agents and meeting assistants to contact centers and medical scribes.

• Companies like Zoom, Granola, Fireflies, Cluely, and Calabrio rely on AssemblyAI to ship production-ready voice AI
• Raised $115M+ from Accel, Insight Partners, Y Combinator's AI Fund, Patrick and John Collison, Nat Friedman, and Daniel Gross
• Remote team building one of the next great AI companies