[Hiring] ML Platform and Inference Engineer @Jalasoft

Role Description

We're looking for a content developer for its Master in AI Systems Engineering. You'll design:

• Module content
• Labs
• Reference implementation
• Evaluation harness
• Instructor guide

Qualifications

• 5+ years shipping production software, including 2+ in production AI/ML
• Able to personally build the course artifact to production standard
• Public evidence of technical writing (docs, technical blog, open-source project)
• Reproducibility discipline (pinned dependencies, containers, seeded runs)
• Professional written English
• Willing to hand over developed material to the program (course will be taught by others)
• Track record fine-tuning classical ML / small foundation models
• Experience shipping containerized inference services to production
• Experience with multi-tenant serving in production (routing, queueing, isolation)
• Track record in quantization and caching, with demonstrable serving cost reduction

Requirements

• Tech Stack: Docker, Modal (CPU/T4/A10 and H100/A100), Hugging Face Hub, scikit-learn, PyTorch, vLLM, Prometheus, Grafana, Locust or k6
• Remote work modality (home office)
• Joining a dynamic and growing organization with international reach