[Hiring] Member of Technical Staff, GPU / ML Systems @SkyPilot

Role Description

SkyPilot exists because GPUs are scarce, expensive, and scattered — and the workloads that need them (pre-training, post-training, RL, high-throughput inference) push hardware to its limits. We're looking for an engineer to own the GPU and ML-systems layer that frontier AI teams run on:

• Accelerator scheduling and utilization
• The serving path
• The integrations that make SkyPilot the fastest, most cost-efficient place to run demanding AI workloads

A few points of GPU utilization here can save a team millions in compute and days on every training run.

What you'll do:

• Own GPU scheduling, utilization and health: how SkyPilot discovers, packs, and binpacks accelerator capacity across clouds and Kubernetes, with real-time GPU health monitoring and automatic failure recovery.
• Build optimizations for training and serving: Enable large scale pre-training with node hot-swapping, design storage systems for fast model checkpointing, container migration, inference autoscaling and multi-cluster serving, preemption handling, and sandboxes for training, RL rollouts, and evals.
• Make the AI stack run great out of the box: deepen integrations with vLLM, PyTorch, Slime, and the frameworks teams use for pre-training and high-throughput inference.

Qualifications

• Hands-on experience with GPU or accelerator systems and with ML training or inference infrastructure.
• Strongly preferred:
  • Familiarity with the modern ML ecosystem (e.g. vLLM, PyTorch, CUDA, verl/slime) and workload-orchestration frameworks (e.g. Kueue, KAI, KServe).
  • You've done real ML-systems performance work - tell us about a bottleneck you hunted down (a stalled data pipeline, GPUs idling on a scheduling gap, communication you overlapped with compute) and what you measured before and after.
  • Strong Python, and comfort reaching into systems-level and GPU-adjacent details.
  • You care about squeezing most from the compute available to you.
  • Experience operating large-scale training or high-throughput inference in production.

Benefits

• Competitive compensation and equity.
• Comprehensive medical, dental, vision coverage for you and your dependents.
• Company 401(k) plan.
• The chance to work with some of the best minds in cloud, distributed, and AI systems — with significant autonomy and ownership.
• A front-row seat at the latest open-source infra startup from Berkeley.
• Gourmet lunch & dinner for the team to do their best work.

Location

San Mateo, CA. Remote will be considered for exceptional candidates.