[Hiring] Member of Technical Staff @SemiAnalysis

Role Description

We are seeking a highly motivated & skilled Member of Technical Staff to join our growing engineering team. The Member of Technical Staff will play a crucial role in developing inference benchmarks & system modelling. You will also play a role in writing and preparing our newsletter articles for publishing, with the opportunity for direct authorship recognition. We are hiring individual contributors at all experience levels. Compensation will be competitive.

As part of the interview process, you'll complete a paid coding challenge designed to reflect typical daily tasks at SemiAnalysis. Compensation will be competitive depending on experience, skillset, location & business needs.

Key Responsibilities

• Conduct training & inference performance benchmarks across various AI hardware (e.g. NVIDIA H100, AMD Mi300X, Google TPUs, AWS Trainium2) using frameworks such as PyTorch, JAX, vLLM, SGLang, etc.
• Author detailed technical research reports analyzing benchmark results, hardware performance, scalability, & efficiency.
• Develop comprehensive system modelling using Python & NCCL for existing & future AI compute clusters, scaling from single-GPU setups to O(100k) GPU clusters.
• Establish and maintain strategic partnerships & collaborations with over 50 leading neocloud providers & AI chip manufacturers, including AMD, NVIDIA, and other industry stakeholders.
• Stay current on emerging trends & technologies by attending major industry & academic conferences such as NeurIPS, MLSys, NVIDIA GTC, AMD’s Advancing AI, etc.

Qualifications

• Proactive, self-motivated, and capable of working independently in a global team.
• Demonstrated experience in ML frameworks such as PyTorch or JAX through professional experience, personal projects, or personal Substack blogs.
• Solid understanding of at least 1 of the following: transformer architecture, LLM parallelism strategies, and/or CUDA parallel programming.
• Strong research skills and the ability to synthesize information from various sources to draw insights.
• English language proficiency required, Chinese language proficiency preferred.

Benefits

• Generous PTO.
• Office stipends.
• Competitive healthcare (medical, dental, vision).
• Support for conferences and ongoing learning.