[Hiring] Engineering Manager @Modular

Role Description

ML developers today face significant friction in taking trained models into deployment. They work in a highly fragmented space, with incomplete and patchwork solutions that require significant performance tuning and non-generalizable, model-specific enhancements. At Modular, we are building the next generation AI platform that will radically improve the way developers build and deploy AI models. As part of our mission to build AI's unified compute layer, we are expanding the Modular software stack to a variety of new and exciting hardware platforms.

We are looking for an Engineering Manager to lead the Hardware Bringup team at Modular. In this role, you will own the end-to-end delivery of accelerator bring-up across the Modular stack from Mojo kernels and the graph compiler to MAX model serving across multiple concurrent hardware partnerships. This is a hands-on management role:

• Work with the HW Bringup architect to set the team roadmap and the technical direction.
• Align stakeholders and ensure all projects are delivered on time.
• Participate in design reviews and Pre-sales discussions.
• Accountable for scoping and delivering against engineering Statements of Work (SOWs) with vendor counterparts.
• Grow a high-trust team that consistently ships against ambitious, externally-committed milestones.

LOCATION:

Candidates based in the US, Canada, and UK are welcome to apply. You can work in our office in Los Altos, CA, or Edinburgh, or remotely from home. Onboarding for new hires is conducted in-person at the appropriate office.

Qualifications

• 7+ years of industry experience in compiler engineering, high-performance computing, kernel development, or related domains, with 2+ years managing engineers.
• Strong technical foundation in compilers, systems software, or accelerator programming.
• Sufficient to be hands-on with the team's codebase, lead architecture discussions, and credibly review designs in MLIR/LLVM, kernel codegen, or runtime systems.
• Proficiency in C++ and direct experience working in complex, multi-component software systems.
• Hands-on experience with at least one heterogeneous programming model (CUDA, SYCL, OpenCL, or similar).
• Demonstrated track record of delivering multi-quarter technical roadmaps with external dependencies.
• Experience working directly with hardware vendor engineering teams on joint bring-up efforts.
• Experience scoping or negotiating engineering deliverables under formal agreements (SOWs, joint engineering plans, or equivalent contractual frameworks).
• Strong written communication.

Requirements

• Experience leading bring-up on non-GPU accelerators (DSPs, NPUs, custom ASICs, or other novel architectures) - helpful, but not required.
• Familiarity with MLIR or LLVM compiler infrastructure at a contributor level - helpful, but not required.
• Background in AI compilers, kernel libraries, or GPU DSLs/DSELs such as Triton, CUTLASS, or CuTe - helpful, but not required.
• Familiarity with how AI operators are implemented at a low level - custom kernels, fused operators, or framework-level integration (e.g., PyTorch at the C++ layer) - helpful, but not required.
• Experience drafting, negotiating, or executing engineering SOWs with hardware vendors or cloud partners - helpful, but not required.
• Exposure to model serving or inference optimization workflows at production scale - helpful, but not required.

Benefits

• Amazing Team: We are a progressive and agile team with some of the industry’s best engineering and product leaders.
• World-class Benefits: Comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities.
• Competitive Compensation: Very strong compensation packages, including RSU grants.
• Team Building Events: Regular team onsites and local meetups in Los Altos, CA, as well as different cities.

The estimated base salary range for this role to be performed in the US, regardless of the state, is $216,000–$372,000 USD. The estimated base salary range for this role to be performed in Canada, regardless of the province, is $207,000–$310,000 CAD. The estimated base salary range for this role to be performed in Edinburgh is £120,000–£206,400 GBR. The salary for the successful applicant will depend on various permissible, non-discriminatory job-related factors.

For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply, as we may have upcoming openings at lower or higher levels than the one advertised.