[Hiring] Senior Product Manager, Observability Tools @Asapp

Role Description

At ASAPP, our mission is simple: deliver the best AI-powered customer experience—faster than anyone else. We’re seeking technologists and problem solvers who thrive in fast-paced environments, love collaborating with great talent, and approach every day like it’s Day 1.

This is not a reporting role. You will own the tools that let builders and reviewers see, test, and trust how GenerativeAgent (GA) actually behaves — before it ever talks to a customer, and after.

What You Will Do:

• Own scenario creation via the simulation agent.
• Lead product for the tools that let builders generate and curate realistic test scenarios.
• Own our evals surfaces, including mistake monitoring and structured data evals.
• Define how we detect, surface, and categorize GA mistakes at scale.
• Own the Previewer tool for builders to see configurations in real simulated conversations.
• Own Conversation Explorer for reviewers to read through full production conversations.
• Build the case for simulation-driven quality.
• Partner deeply with Research and Engineering on the underlying agent architecture.
• Manage the trust layer of the review experience.

Qualifications

• 5+ years of product management experience, with meaningful time spent on testing, quality, or review/analytics products in enterprise B2B SaaS.
• Direct experience building products around LLMs, AI agents, or other applied AI systems.
• Experience shipping tools that simulate, test, or preview system behavior before it reaches production.
• Experience building review or audit tooling for complex, unstructured content.
• Comfort partnering with research and engineering teams on system internals.
• Track record of running discovery with internal or external users and translating it into structured requirements.
• Excellent written and verbal communication.

Requirements

• Experience in contact centers, conversational AI, or customer experience (CX) analytic - a plus.
• Experience with evaluation frameworks or methodologies for generative AI systems.
• Prior experience in a startup or fast-scaling environment.

Benefits

• Competitive compensation
• Stock options
• Healthcare for the family group
• Mac equipment
• USD 150 per month in flexible benefits
• 3 weeks of vacation
• English lessons