[Hiring] Director, Enterprise Quality Engineering and Agentic Evaluation @Zayo Group

Role Description

We are seeking an experienced Director, Enterprise Quality Engineering and Agentic Evaluation to build and lead a modern enterprise quality capability across Zayo’s technology organization. This role will be accountable for improving the reliability, predictability, and speed of technology delivery while providing independent assurance for critical business platforms, transformational programs, and AI-enabled solutions.

The successful candidate will combine deep quality engineering expertise with strong enterprise leadership, bringing a risk-based, automation-first approach to how quality is embedded across the software delivery lifecycle. The role will also shape how Zayo evaluates and governs emerging agentic AI capabilities, ensuring they are reliable, controlled, and ready for enterprise-scale adoption.

This is a highly collaborative and transformational leadership role, partnering across Engineering, Product, Architecture, Data and AI, Operations, and business teams to strengthen quality outcomes, reduce production risk, and establish a culture of measurable engineering excellence.

Key Responsibilities

• Define and lead Zayo’s enterprise quality engineering strategy, operating model, roadmap, service catalog, standards, and governance.
• Own the enterprise quality engineering platform, including Tosca, qTest, automation assets, integrations, test execution infrastructure, quality reporting, and AI-evaluation capabilities.
• Establish risk-based quality models, release-readiness criteria, quality gates, certification standards, and evidence requirements for critical platforms, business processes, integrations, data products, and AI agents.
• Lead a centralized quality engineering service that plans, automates, executes, and governs testing across enterprise products, platforms, programs, and high-risk releases.
• Develop reusable automation frameworks, model-based testing patterns, API and integration testing capabilities, regression suites, and continuous testing practices aligned to business risk and production impact.
• Establish enterprise capabilities for AI-agent evaluation, including scenario design, evaluation datasets, regression testing, tool-use validation, policy and permission checks, human escalation criteria, and production quality monitoring.
• Own the enterprise approach to test data, test environments, service virtualization, production validation, and quality analytics to reduce release risk and delivery delays.
• Provide independent quality intelligence and release-risk assessments to engineering, product, program, and executive stakeholders.
• Manage vendor-outsourced quality engineering resources, Tricentis partners, systems integrators, and specialist testing providers to deliver sustained enterprise quality outcomes.
• Build a quality engineering culture focused on automation, objective assurance, reuse, engineering discipline, measurable outcomes, and continuous improvement.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Mathematics, or a related discipline; equivalent relevant experience may be considered.
• Minimum of twelve (12) years of experience in quality engineering, software testing, test automation, platform engineering, enterprise technology delivery, or related technology disciplines, including 5+ years leading quality engineering, test automation, enterprise testing, or platform-oriented teams.
• Demonstrated experience building or leading modern quality engineering capabilities beyond manual test execution, including automation strategy, risk-based testing, continuous testing, quality gates, and release assurance.
• Strong experience with enterprise test automation and test management platforms, preferably Tricentis Tosca and qTest.
• Experience leading testing or quality engineering across multiple products, platforms, business processes, programs, or business units.
• Strong understanding of API, integration, data, workflow, cloud, event-driven, distributed-system, performance, resilience, and production validation testing.
• Practical knowledge of generative AI, large language models, retrieval, AI agents, tool calling, evaluation methods, and responsible AI testing practices.
• Strong executive communication, stakeholder management, vendor management, financial management, organizational leadership, and decision-making skills.

Requirements

• Estimated base salary range: $126,600 - $194,700 USD/annually.
• This position is not eligible for employment-based visa sponsorship. Zayo will not provide, transfer, or assume sponsorship for any employment visa or work authorization for this position now or in the future.

Benefits

• Excellent Health, Dental & Vision Insurance
• Retirement 401(k) Savings Plan
• Generous paid time off policy including paid parental leave