[Hiring] Senior / Lead Machine Learning Engineer @Inworld AI

Role Description

Inworld is looking for strong individuals from varied backgrounds who learn fast, thrive in ambiguity, and can demonstrate their experience in building, breaking, and understanding complex systems.

Qualifications

• PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems.
• Professional fluency in English (written and spoken) is required.

Requirements

• Inference Optimization: Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM.
• Model Acceleration: Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding.
• High-Performance Systems: Proficiency in C++, CUDA, Rust, or highly optimized Python; ability to profile code for performance optimization on NVIDIA GPUs.
• Distributed Systems & Scaling: Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling thousands of concurrent connections.
• Public work: Contributions to non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups.
• Full-cycle ownership: Ability to take a model from the research team, containerize it, optimize its serving, and ensure reliable production performance.

Benefits

• Full U.S. visa and relocation support may be available for candidates interested in relocating to the San Francisco Bay Area, subject to business needs and applicable legal and work authorization requirements.

Company Description

Inworld is a product-oriented research lab of top AI researchers and engineers, developing best-in-class realtime multimodal models and the only realtime orchestration platform optimized for thousands of queries per second.

• Raised more than $125M from notable investors including Lightspeed, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, and Stanford.
• Technology has powered experiences from companies such as NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat.
• Recognized by CB Insights as one of the 100 most promising AI companies globally.
• Named one of LinkedIn's Top 10 Startups in the USA.