[Hiring] Lead Software Engineer @EPAM Systems

Role Description

We are seeking a Lead Software Engineer to drive the design and growth of an AI Gateway that delivers secure, scalable LLM access in SAAS. You will shape MCP server and agent workflows, set governance and observability standards, and guide teams on architecture patterns and quality gates.

• Develop the AI Gateway platform across MCP, agents, LLM routing, governance, and observability
• Translate business and product needs into crisp problem statements, architectural designs, and scalable technical solutions
• Design extensible frameworks for MCP server capabilities and integrations, plus agent orchestration and reusable agent skills
• Architect gateway features such as semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage
• Define and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
• Build prototypes and reference implementations to validate architectural decisions and guide engineering teams
• Collaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patterns
• Review designs and code, providing actionable feedback to improve quality, performance, scalability, and security
• Define and review CI/CD best practices using modern GitHub-based pipelines
• Architect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readiness

Qualifications

• 5+ years of software engineering experience, including major ownership in a principal engineer role
• Hands-on experience designing and shipping large-scale distributed systems or platform products
• Strong programming skills in Golang and Python
• Solid background in AI centric development with a strong focus on quality gates and architecture patterns that enforce agentic behavior for producing quality code
• Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability
• Demonstrated experience with microservices and service-oriented architectures for multi-tenant SAAS environments
• Practical knowledge of PostgreSQL for transactional data and Redis for caching and distributed coordination
• Strong background in authentication and authorization systems, particularly OAuth-based approaches
• Proven ability to independently drive problem definition, architecture, prototype, and execution guidance
• Demonstrated experience designing platforms and frameworks used by multiple product teams
• English proficiency at B2 level or higher

Requirements

• Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks
• Knowledge of working with EDA software
• Prior work on LLM gateways, API gateways, or AI middleware platforms
• Experience building generic developer frameworks or SDKs adopted across teams
• Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques
• Experience operating high-throughput, low-latency systems in Kubernetes environments
• Strong written and verbal communication skills for cross-team architectural alignment