[Hiring] QA Automation Engineer II @Milliman

Role Description

What you'll be doing:

• Design, document, maintain, and execute test cases for new features, enhancements, integrations, and regression coverage.
• Perform functional, exploratory, integration, smoke, regression, and end-to-end testing across web-based user interfaces and APIs.
• Validate user workflows, business rules, field behavior, navigation, error handling, usability, and cross-browser behavior.
• Test REST APIs using tools such as Postman, including requests, responses, status codes, payloads, authentication, validation rules, and negative scenarios.
• Use SQL and available logs or diagnostic information to validate data and investigate issues across application layers.
• Review requirements, user stories, acceptance criteria, and technical designs to identify gaps, edge cases, dependencies, and quality risks before development is complete.
• Create clear, reproducible defect reports that include expected and actual results, supporting evidence, business impact, and appropriate severity.
• Collaborate with developers to troubleshoot issues, verify fixes, and determine appropriate regression coverage.
• Maintain test cases, execution results, and traceability in Zephyr or a comparable test management tool.
• Participate actively in Agile ceremonies, including refinement, sprint planning, daily stand-ups, demonstrations, and retrospectives.
• Provide concise input on release readiness, unresolved risks, and recommended follow-up testing.
• Identify stable, repetitive test scenarios that are strong candidates for automation.
• Execute and review automated test suites where applicable, troubleshoot basic failures, and partner with automation-focused engineers to improve coverage.
• Contribute to UI or API automation over time based on experience, interest, and team priorities.

Qualifications

• 2+ years of software quality assurance or software testing experience.
• Strong hands-on experience manually testing web-based applications.
• Experience testing APIs with Postman or a similar tool.
• Ability to create effective test cases, test scenarios, and exploratory test charters from requirements and acceptance criteria.
• Experience with functional, integration, regression, negative, and end-to-end testing techniques.
• Experience documenting and managing defects in Jira or a similar tracking tool.
• Working knowledge of SQL for test data setup, backend validation, or defect investigation.
• Experience using generative AI tools to support software testing activities—such as test case development, exploratory testing, test data creation, defect investigation, or test automation—with appropriate review and validation of AI-generated outputs.
• Experience working within an Agile or Scrum delivery team.

Requirements

• Strong analytical, troubleshooting, communication, and collaboration skills.
• Ability to learn unfamiliar business workflows and technical systems with appropriate guidance.

Wish list

• Experience with Zephyr, TestRail, or another test management platform.
• Exposure to UI or API test automation through professional experience, training, or personal projects.
• Familiarity with automation tools or frameworks such as Playwright, RestSharp, Reqnroll, Selenium, or comparable technologies.
• Basic programming or scripting experience in C#, JavaScript, TypeScript, Java, Python, or a similar language.
• Experience executing automated tests through a CI/CD pipeline and reviewing results.
• Experience using generative AI tools to support test design, test data creation, defect analysis, or automation, with appropriate human review.
• Experience testing software-as-a-service (SaaS) or other complex business applications.

Location

The expected application deadline for this job is November 30, 2026. This position is open to remote work. Applicants must be willing to travel to the Milliman office in Brookfield, WI as needed and travel nationwide for meetings, conferences, and team events.

Compensation

The overall range for this role is $78,800 - $145,130.

• For candidates residing in: Alaska, California, Connecticut, Illinois, Maryland, Massachusetts, New Jersey, New York City, Pennsylvania, Virginia, Washington, or the District of Columbia the range is $90,620 - $145,130.
• All other locations the range is $78,800 - $126,200.

A combination of factors will be considered, including, but not limited to, education, relevant work experience, qualifications, skills, certifications, etc.

Individual(s) must be legally authorized to work in the United States without the need for immigration support or sponsorship from Milliman now or in the future.

Benefits

• Medical, Dental and Vision - Coverage for employees, dependents, and domestic partners.
• Employee Assistance Program (EAP) - Confidential support for personal and work-related challenges.
• 401(k) Plan - Includes a company matching program and profit-sharing contributions.
• Discretionary Bonus Program - Recognizing employee contributions.
• Flexible Spending Accounts (FSA) - Pre-tax savings for dependent care, transportation, and eligible medical expenses.
• Paid Time Off (PTO) - Begins accruing on the first day of work. Full-time employees accrue 15 days per year, and employees working less than full-time accrue PTO on a prorated basis.
• Holidays - A minimum of 10 paid holidays per year.
• Family Building Benefits - Includes adoption and fertility assistance.
• Paid Parental Leave - Up to 11 weeks of paid leave for employees who meet eligibility criteria.
• Life Insurance & AD&D - 100% of premiums covered by Milliman.
• Short-Term and Long-Term Disability - Fully paid by Milliman.

Equal Opportunity

All qualified applicants will receive consideration for employment, without regard to race, color, religion, sex, sexual orientation, national origin, disability, or status as a protected veteran.