Technical Program Manager, Cloud Inference @Modular
Project Management
Salary $134,400 - $168..
Remote Location
Employment Type full-time
Posted YDay

[Hiring] Technical Program Manager, Cloud Inference @Modular

YDay - Modular is hiring a remote Technical Program Manager, Cloud Inference. πŸ’Έ Salary: $134,400 - $168,000 per year πŸ“Location: USA, Canada

Role Description

Cloud Inference builds and operates the serving infrastructure behind Modular's inference products: Kubernetes-native, cluster-level orchestration that runs large language models in production for customers, on any cloud and across multiple hardware vendors. The team owns cluster orchestration, multi-cluster routing, and the deployment path that gets new model and engine versions safely into production.

This is a hands-on, technical role. You sit between Cloud Inference and the MAX product and customer-facing teams that depend on it, turning goals like higher throughput per GPU, lower cost per token, faster model bring-up, and fewer production incidents into work that ships. You work on systems carrying live customer traffic, where a rollout decision shows up in latency and spend the same day.

Working closely with engineering and product leaders, you bring structure to how work is planned, tracked, and communicated. You join design and capacity discussions, help teams build realistic plans, and surface risk early, shaping engineering decisions across the org.

Qualifications

  • Bachelor's degree in a technical field, or equivalent practical experience.
  • 8 years of experience in technical program management, engineering management, or infrastructure engineering.
  • Experience with production cloud infrastructure at scale: distributed systems, Kubernetes, or GPU-backed services.
  • Experience running programs for AI inference or model serving in production, including latency and throughput targets under live customer traffic.
  • Excellent written communication skills, with the ability to make technical detail clear to people outside the work, including customers.

Requirements

  • Bachelor's degree in Engineering, Computer Science, or related field.
  • 4+ years of Program Management or related work experience.
  • Completed advanced degrees in a relevant field may be substituted for up to two years (Master’s = one year, Doctorate = two years) of work experience.

Helpful, but not required

  • Ability to reason about where a serving system loses performance or money, and to tell a real regression from noise.
  • Experience with capacity planning for GPU fleets, including forecasting, utilization, and vendor commitments.
  • Experience coordinating work across multiple hardware vendors or cloud providers.
  • Experience setting the planning and reporting cadence for an engineering organization.

Benefits

  • Amazing Team: We are a progressive and agile team with some of the industry’s best engineering and product leaders.
  • World-class Benefits: Comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities.
  • Competitive Compensation: Strong compensation packages, including RSU grants.
  • Team Building Events: Regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.

Salary Information

The estimated base salary range for this role to be performed in the US, regardless of the state, is $143,400.00 - $277,200.00 USD. The estimated base salary range for this role to be performed in Canada, regardless of the province, is $134,400.00–$168,000.00 CAD. The salary for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future. The total compensation for a candidate will also include annual target bonus, equity, and benefits.

Before You Apply
️
remote Be aware of the location restriction for this remote position: USA, Canada
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Technical Program Manager, Cloud Inference @Modular
Project Management
Salary $134,400 - $168..
Remote Location
Employment Type full-time
Posted YDay
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 140,000+ Remote Jobs
️
remote Be aware of the location restriction for this remote position: USA, Canada
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 140,000+ Remote Jobs
Γ—
Apply to the best remote jobs
before everyone else

Access 140,000+ vetted remote jobs and get daily alerts.

4.9 β˜…β˜…β˜…β˜…β˜… from 500+ reviews

⚑ 142,216+ remote jobs, refreshed hourly

πŸ”” Real-time alerts: Apply first, direct to employer

πŸ›‘οΈ Vetted companies, no scams, true remote only

Unlock All Jobs Now

Maybe later