[Hiring] Quality Assurance Engineer @Lyrebird Health

Role Description

You’ll own the quality of the Lyrebird platform, from the first commit to the release gate. This is a hands-on, code-first engineering role, not manual test scripting.

• Make our Playwright end-to-end and integration suites faster and more reliable.
• Build contract tests that stop backend changes from silently breaking the web app.
• Design ways to evaluate clinical model output where exact-match assertions don’t work.
• Be the quality partner to our SRE function, providing health checks, synthetic monitors, load test results, and post-deployment signals.
• Give a clear yes or no on release readiness, backed by evidence.

This role suits an engineer who sees testing as a craft and treats a test suite as production code.

• Comfortable moving between TypeScript and Python.
• Enjoys deleting flaky tests and cutting minutes off a pipeline.
• Prefers helping other engineers write better tests rather than being the only one who writes them.
• Enjoys solving the hard problem of proving that non-deterministic AI output is safe and accurate for clinicians.

Qualifications

• Strong test automation experience in both TypeScript and Python, writing tests as production-quality code.
• Deep hands-on experience with Playwright, plus component testing with Vitest and Testing Library.
• Solid pytest skills, including async tests, fixtures, mocking, and test data factories such as polyfactory or Faker.
• Experience running tests in CI pipelines (ideally Buildkite) and in Docker, with coverage measurement and reporting.
• Working knowledge of SQL and Postgres, and confidence testing at the database layer.
• Experience with API contract testing against OpenAPI schemas.

Requirements

• Experience evaluating large language model output with tools such as DeepEval, openevals, or Langfuse (nice to have).
• Load testing experience with Locust (nice to have).
• Familiarity with Svelte, Storybook, or Supabase and its CLI-based database testing (nice to have).
• Experience with observability tools such as Sentry, OpenTelemetry, and Honeycomb (nice to have).
• A background in healthcare, clinical software, or other regulated, safety-critical environments (nice to have).

Benefits

• Every test you write protects a clinician relying on Lyrebird.
• Contribute to a platform that allows clinicians to spend less time on admin and more time on care.
• Be part of a team that reflects the diversity of the people who benefit from our work.
• Lyrebird aims to be a place where everyone feels safe, supported, and able to thrive.
• Encouragement for applicants from underrepresented backgrounds in tech.