[Hiring] Senior Performance Engineer @Akamai

Role Description

Do you thrive on optimizing AI systems for peak performance? Are you ready to push the boundaries of inference speed & efficiency - and set the standard for how it's done? Join the Akamai Inference Cloud Team!

The Senior Performance Engineer oversees benchmarking, optimization strategies, and performance of the AI inference platform. Responsibilities include:

• Leading benchmarking and profiling of AI models and inference workloads across different hardware configurations, measuring latency.
• Researching and implementing model optimization techniques including quantization, pruning, distillation, and hardware-specific optimizations.
• Optimizing and refining inference frameworks and infrastructure to enhance performance, collaborating with TensorRT, vLLM, TorchServe, Triton, and related platforms.
• Owning the performance baselines and regression monitoring strategy for the platform, and driving resolution of systemic and complex performance issues.
• Leading technical efforts across engineering teams, resolving inefficiencies, designing optimization strategies, verifying enhancements, and guiding engineers in performance-focused approaches.

Qualifications

• Very good experience in performance engineering with hands-on expertise in AI/ML model optimization and inference performance tuning.
• Expertise in inference optimization techniques like quantization, model compilation, hardware acceleration, and ML compilers to achieve measurable production improvements.
• Proficiency with GPU optimization and understanding of memory hierarchies and techniques to maximize hardware utilization.
• Experience with profiling and benchmarking tools for AI workloads, identifying performance bottlenecks in distributed systems.
• Effective communication abilities, aligning engineering, product, and infrastructure teams to shape and guide technical direction.
• Problem-solving skills with the ability to analyze performance data.
• Knowledge of distributed inference and model parallelism techniques.
• Experience with cost optimization for compute-intensive workloads.

Benefits

• FlexBase, Akamai's Global Flexible Working Program, allows 95% of employees the choice to work from home, the office, or both.
• Opportunities to grow, flourish, and achieve great things.
• Benefit options designed to meet individual needs for health, finances, family, work-life balance, and personal pursuits.

Company Description

Akamai powers and protects life online. Leading companies worldwide choose Akamai to build, deliver, and secure their digital experiences, helping billions of people live, work, and play every day. With the world's most distributed compute platform—from cloud to edge—we make it easy for customers to develop and run applications while keeping experiences closer to users and threats farther away.