[Hiring] Senior AI Test Engineer @TestPros

Role Description

TestPros is seeking a Senior Artificial Intelligence (AI) System Test Engineer with an analytical, customer-focused mindset and experience with the OWASP AI Testing Guide and other guidelines from NIST, ISO, and IEEE.

• Focus: Software test end evaluation
• Regulatory Basis: OWASP AI Testing Guide
• Location: Remote, with occasional travel to customer sites or TestPros labs in Sterling, VA

This role evaluates AI systems and software for alignment with the intended functions and features, plus additional assessment focused on AI-specific validation, including:

• Model robustness
• Data integrity
• Adversarial defense
• Performance
• Usability
• Reliability
• Security
• Maintainability
• Safety
• Other aspects of overall quality

Key Responsibilities:

• Develop and execute test plans and evaluate software for compliance with the OWASP AI Testing Guide and other guidance
• Create defect and remediation records
• Capture test evidence and document defects with clear reproduction steps and severity ratings
• Report results to senior management and stakeholders

Qualifications

• Bachelor's degree in computer science, engineering or a related field
• 10+ years of experience in Software/System Testing and Quality Engineering (QE), including enterprise-scale transformation programs
• 4+ years hands-on experience defining the testing strategy for large scale programs and ensuring requirements traceability throughout the system development lifecycle
• A deep understanding of testing planning and associated delivery challenges
• A strong understanding of various testing techniques - white-box, black-box, load testing, coverage testing, and regression testing
• Proven experience in defining and executing QE transformation strategy
• Hands-on expertise in Agentic AI / GenAI frameworks (e.g., LangChain, AutoGen, CrewAI, Cursor, etc.)
• Experience working in Cloud, Web and Mobile Testing platforms - Saucelabs, Browserstack preferred
• Hands-on experience with machine learning models
• Experience in Python NLTK or similar natural language processing technology
• Practical experience implementing AI-driven QE solutions such as:
  • Autonomous test generation
  • Self-healing automation
  • Defect prediction and intelligent triaging
• Expertise in test automation tools (Selenium, Playwright, Cypress, etc.)
• Strong experience with CI/CD pipelines and DevOps integration (GitHub)
• Solid understanding of API, microservices, and cloud-native architectures
• Experience evaluating or testing AI Large Language Model (LLM)-based application features (e.g., chatbots, copilots, RAG-based systems)
• Exposure to AI-assisted defect triage or root-cause analysis tools that reduce manual investigation time
• Experience with cloud platforms (AWS, Azure, GCP) in QE/AI context
• Exposure to self-healing test automation frameworks (AI-driven locator repair, visual AI testing)
• Understanding of responsible AI/testing governance principles (bias detection, explainability, model validation) as applied to QE
• Experience contributing to or influencing AI-adoption roadmaps within a testing/QE organization
• Experience implementing testing best practices specific to the test planning and execution processes and gaining buy-in for changes from executives

Preferred Skills

• Experience with test automation tools and AI-assisted test tools
• Familiarity with JIRA project/test management system
• Knowledge of other IT compliance such as WCAG/Accessibility, IT Security, IT Privacy
• Professional certifications in the software testing discipline

Work Environment

• Hands-on testing role
• Remote-friendly with occasional on-site or hybrid work as needed

Rate

$50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a guarantee; final compensation is determined by factors such as experience, qualifications, and government contract labor rate requirements and may fall outside the stated range.

Equal Opportunity Employer

TestPros is an equal-opportunity employer and does not discriminate in employment based on race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or any other non-merit factor.

Offer Considerations

TestPros considers several factors when extending an offer, including but not limited to, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, geographic location, education, and certifications.

Federal Compliance

As a federal contractor, TestPros is subject to all federal and state mandates and/or other customer requirements.