[Hiring] Senior Engineering Manager, Inference @CoreWeave

Role Description

As a Senior Engineering Manager for the AI/ML Platform team, you will lead the group responsible for productizing and operating our inference offering. In partnership with CoreWeave AI platform team, you will ensure the service becomes a polished, reliable, developer-friendly product within the AI/ML Platform.

• Guide engineers working on areas such as service reliability, observability, operational excellence, packaging, developer-facing tooling, and application-layer enhancements.
• Partner closely with Product, CoreWeave engineering teams, Design, Support, and GTM stakeholders to ensure the inference experience meets the needs of practitioners deploying and scaling real-world AI workloads.
• Support end-users and other products powered by this service, like W&B Training.
• Combine strong engineering leadership with clarity in execution to help the team deliver improvements that raise reliability, accelerate development workflows, and strengthen the overall inference experience for W&B users.

Qualifications

• 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services.
• Fluent in concepts related to distributed compute services, including observability, autoscaling patterns, reliability engineering, API design, and service operations.
• Comfortable with competing priorities and making principled trade-offs among latency, reliability, cost, and development velocity.
• Skilled at leading engineering teams through ambiguous, multi-stakeholder projects with strong communication and alignment.
• Deep empathy for ML practitioners and platform developers, with a drive to improve reliability, reduce friction, and elevate the developer experience.

Requirements

• Background in high-scale systems, real-time APIs, or cloud infrastructure, ideally with exposure to model-serving or inference-adjacent domains.
• Background in related platform domains such as IAM, billing/metering, observability systems, or deployment tooling.

Benefits

• Medical, dental, and vision insurance - 100% paid for by CoreWeave.
• Company-paid Life Insurance.
• Voluntary supplemental life insurance.
• Short and long-term disability insurance.
• Flexible Spending Account.
• Health Savings Account.
• Tuition Reimbursement.
• Ability to Participate in Employee Stock Purchase Program (ESPP).
• Mental Wellness Benefits through Spring Health.
• Family-Forming support provided by Carrot.
• Paid Parental Leave.
• Flexible, full-service childcare support with Kinside.
• 401(k) with a generous employer match.
• Flexible PTO.
• Catered lunch each day in our office and data center locations.
• A casual work environment.
• A work culture focused on innovative disruption.