[Hiring] Chief Software Engineer @EPAM Systems

Role Description

We are seeking a Chief Software Engineer to lead a secure, scalable AI Gateway for governed LLM and agentic workflows in multi-tenant SAAS. You will shape MCP server frameworks, routing, governance, observability, and Kubernetes delivery while partnering across product teams.

• Build the AI Gateway platform across MCP, agents, LLM routing, governance, and observability.
• Translate business and product requirements into crisp problem statements, architecture designs, and scalable technical solutions.
• Design extensible frameworks for MCP server capabilities and integrations, along with agent orchestration and reusable agent skills.
• Architect gateway features including semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage.
• Define and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic.
• Create prototypes and reference implementations to validate architectural choices and guide engineering teams.
• Collaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patterns.
• Review designs and code to deliver actionable feedback that improves quality, performance, scalability, and security.
• Define and review CI/CD best practices using modern GitHub-based pipelines.
• Architect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readiness.

Qualifications

• Proven track record with 7+ years of software engineering experience, including significant responsibility in a principal engineer role.
• Demonstrated experience designing and shipping large-scale distributed systems or platform products.
• High proficiency in Golang and Python for production-grade services.
• Hands-on familiarity with AI centric development, emphasizing quality gates and architecture patterns that enforce agentic behavior for producing quality code.
• Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability.
• Solid background with microservices and service-oriented architectures for multi-tenant SAAS environments.
• Practical skills using PostgreSQL for transactional data and Redis for caching and distributed coordination.
• Strong expertise in authentication and authorization systems, especially OAuth-based approaches.
• Proven ability to independently drive problem definition, architecture, prototype, and execution guidance.
• Experience designing platforms and frameworks consumed by multiple product teams.

Requirements

• Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks.
• Knowledge of working with EDA software.
• Prior work on LLM gateways, API gateways, or AI middleware platforms.
• Experience building generic developer frameworks or SDKs adopted across teams.
• Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques.
• Experience operating high-throughput, low-latency systems in Kubernetes environments.
• Strong written and verbal communication skills for cross-team architectural alignment.