[Hiring] AI Backend Engineer @Avomind

Role Description

Our client is seeking a AI Backend Engineer to build and operate the backend infrastructure that powers AI-driven experiences across its products. The role focuses on owning the inference and orchestration layer that sits between AI models and end users, ensuring every interaction is fast, reliable, scalable, and cost-efficient.

Working closely with engineering and AI teams, this position will play a key role in designing production-grade backend services, optimizing system performance, and delivering robust AI-powered features across mobile and desktop platforms.

Key Responsibilities

• Build, maintain, and operate backend systems that power AI-enabled features in production.
• Design and implement AI inference pipelines, orchestration layers, and service architectures around AI models.
• Develop scalable, high-performance APIs that integrate seamlessly with frontend applications and machine learning systems.
• Optimize system performance by improving inference latency, throughput, caching, batching, and streaming capabilities.
• Own production operations, including monitoring, logging, alerting, and incident response.
• Troubleshoot and resolve issues within distributed systems to ensure service reliability and stability.
• Continuously improve backend architecture and production systems based on operational insights and real-world usage.
• Collaborate with cross-functional teams to deliver reliable, scalable, and high-quality AI-powered solutions.

Qualifications

• Strong backend engineering experience in production environments.
• Proven experience building and operating high-throughput, low-latency backend services.
• Experience designing scalable APIs and distributed systems.
• Familiarity with AI inference patterns, including Large Language Models (LLMs), embeddings, and multimodal AI systems.
• Strong debugging and troubleshooting skills within distributed production environments.
• Demonstrated ability to deliver production-ready solutions while iterating based on real-world system performance.
• Excellent analytical, problem-solving, and collaboration skills.

Technical Skills

• Experience with Python.
• Experience with Node.js.
• Experience with PyTorch.
• Experience with OpenAI, Anthropic, or open-source Large Language Models (LLMs).
• Experience with SQL and NoSQL databases.
• Experience with Kubernetes.
• Experience with Docker.