[Hiring] QA Engineer II @AWeber

Role Description

We're currently hiring for remote team members in the following states: DC, DE, GA, MA, MD, NC, NH, NJ, OH, PA, SC, UT, and VA.

At AWeber, agentic development is core to how we build. Our engineers spend most of their time designing solutions for agents to implement and reviewing agent-generated work for quality and correctness. On the QA team, you build the agents that do that work. As a QA Engineer II, you will spend far less time hand-writing test cases than you would elsewhere, and far more time building and improving the agents that generate our coverage, diagnose our failures, and watch our systems, then proving that what they produce can be trusted.

Your mission is to make our quality signals trustworthy, so that a green build actually means something and the team can move fast on top of it. When you find a gap in the process, we expect you to fix it and tell people, not just file it.

• Write the test plan for a feature before a line of it exists.
• Review an agent-generated test suite and reject it if the assertions do not prove the behavior they claim to.
• Explore a new release by hand and find the edge case nobody specified.
• Tighten an agent's harness to stop producing flaky waits.
• Diagnose why a pipeline job fails only in staging.
• Write up the cause of a failure so the next person does not have to rediscover it.

You'll thrive as a QA Engineer II if you:

• Treat a passing test suite as a claim to be verified rather than a result to be trusted.
• Take a project from start to finish on your own, resolve what you can independently, and escalate early on what you cannot.
• Are comfortable being the person who says a release is not ready, and can make that case with evidence instead of instinct.
• Investigate root causes rather than just rerunning a test, and write down what you learned.
• Get genuinely curious about how a system breaks, and go looking for the edge cases nobody wrote a ticket for.
• Default to proactive communication and understanding the value that comes from working in the open.
• See a broken process and fix it, then tell people it changed.
• Stay steady when several priorities compete and a release is in flight.
• Embrace emerging technology while staying skeptical enough to ask what it costs, how it fails, and how we would know.

Qualifications

• 4+ years in QA or test automation in an Agile environment, including hands-on experience building test automation frameworks.
• API testing with Python, using pytest, unittest, or a comparable framework.
• UI testing with Cypress and TypeScript, including the discipline of stable selectors and reliable page objects.
• Demonstrated use of AI development tools and coding assistants to produce, review, or maintain tests.
• Solid understanding of CI/CD pipelines, ideally GitHub Actions.
• Exploratory testing skill: finding meaningful defects in a running product without a script to follow.
• Experience with Docker and containerized environments, Git and modern version control workflows, and API tooling such as Postman or curl.
• Working experience with AWS services in a testing or deployment context.
• Ability to apply proven QA techniques including requirement traceability, boundary value analysis, and application stability and usability testing.
• Strong written communication.
• Proven ability to work self-directed in a deadline-driven environment.

Preferred Qualifications

• Experience building agents and not only using them.
• Experience evaluating agent or LLM output systematically.
• Experience testing in a high-volume agentic or AI-assisted codebase.
• Experience with real-time monitoring and observability tooling.
• Experience with Kubernetes, or testing services deployed across multiple environments.
• Familiarity with performance, load, or security testing.
• Experience in a remote-first, asynchronous engineering culture.
• Background in one of our domains: email or marketing SaaS, web platforms, or backend services at scale.
• Working knowledge of the Atlassian stack (Jira, Confluence).

Benefits

• 100% Remote - we're not going back to the office.
• Strong culture that supports flexibility, entrepreneurialism, and collaboration.
• 100% Company Paid PPO medical, dental, vision insurance (spousal and domestic partner benefits available).
• 4-7 weeks of paid time off and holidays (based on tenure).
• 4 week paid sabbatical (based on tenure).
• 401K retirement plan with 4% company match.
• Company Profit Share.
• Home office equipment and internet stipend.
• Tuition reimbursement, conferences, and learning opportunities.
• Gym Memberships Reimbursement.
• Company Paid Short Term Disability Insurance.
• Company Paid Life Insurance.
• Additional Supplemental Benefits (Long Term Disability, Critical Illness, and Additional Life Insurance).