[Hiring] AI Systems, Model Optimization @Unconventional

Role Description

As a Member of Technical Staff, AI Systems, Model Optimization, you will develop the path from model architecture to physical silicon. You will develop the training techniques, optimization strategies, and infrastructure required to make AI models run efficiently on our novel compute substrates, closing the loop between model design and tapeout.

What You'll Do

• Energy Benchmarking & Performance Modeling: Develop rigorous performance models to evaluate compute, memory, and energy trade-offs. Track pareto-optimality across models and hardware configurations.
• Advanced Mapping & Partitioning: Drive the partitioning and mapping of complex AI models down to hardware. Apply and invent advanced optimization strategies from first principles, including custom quantization schemes, sparsity/pruning, and distillation to fit the physical constraints of our substrates.
• Hardware-Aware Training: Develop and apply Quantization-Aware Training (QAT), noise-aware training, and sparsification techniques to adapt models to the physical constraints of our analog compute substrates, including memory footprint, connectivity, precision, and noise.
• GPU Optimization & Kernel Development: Develop and optimize kernels using low-level programming models like CUDA, Triton, or CUTLASS. Profile and debug complex ML codebases to resolve performance bottlenecks (training and inference).
• Cross-Functional Collaboration: Act as a translator between AI model architects and hardware/infrastructure engineering teams, converting model requirements into concrete specifications and codifying learnings for tapeouts.

Qualifications

• Education: An MS/PhD or equivalent research/project experience in a quantitative field such as AI/Machine Learning, Computer Science, Physics, Electrical Engineering, or Applied Math.
• Experience: Deep, practical understanding of the modern AI/ML stack and optimized compilation and execution of algorithms on modern GPU systems. Proven experience in profiling, identifying, and resolving performance bottlenecks in complex ML codebases.
• Systems Fluency: Demonstrated ability to map state-of-the-art AI model architectures (e.g., Transformers, Mixture of Experts, diffusion models) to system performance implications and apply advanced efficiency techniques such as sparsity, quantization, and distillation.
• Software Development: Deep experience with PyTorch, including its internals, torch.compile, and distributed data parallel (DDP) / fully sharded data parallel (FSDP) libraries.

Requirements

• Preferred Qualifications (Nice to Have):
• Training Infrastructure: Experience with production-grade training frameworks (e.g., Megatron-LM, DeepSpeed) and distributed training at scale.
• Unconventional Co-Design: A forward-looking perspective on co-designing training systems for unconventional computing paradigms that map closely to the physics of underlying systems.
• Next-Gen Efficiency: Research or practical experience in advanced approximation/compression techniques beyond standard quantization, including noise-aware or physics-constrained training.

Benefits

• A comprehensive package including best-in-class health benefits
• 401k matching
• Truly unlimited PTO
• Complimentary meals in our Palo Alto office