[Hiring] AI QA Test Lead @Truliant Federal Credit Union

Role Description

The AI QA Test Lead is a critical quality and risk-management leader responsible for ensuring the reliability, accuracy, and production readiness of the credit union’s AI-driven member and staff experiences. This role owns the overall AI quality assurance strategy, directly safeguarding millions of AI-powered interactions each year by ensuring solutions meet defined standards for accuracy, compliance, brand alignment, and ethical use.

• Designs and manages comprehensive testing plans across conversational AI, generative AI, and agentic AI workflows.
• Partners closely with the AI Program team and Truliant’s business stakeholders, and key vendors to validate new use cases, manage AI-related risk, and ensure all AI releases are thoroughly tested before deployment.
• Manages the end-to-end correction loop with third-party vendors integral to the delivery of Truliant’s AI use cases.
• Defines QA plans, leads end-to-end UAT, validates ethical guardrails, and establishes scalable QA practices that enable safe and confident expansion of Truliant’s AI capabilities.

Qualifications

• Strong understanding of conversational AI, generative AI, NLP, and intent-based bot frameworks.
• Ability to evaluate AI responses for tone, brand voice, compliance, and member experience impact.
• Understanding of credit union business processes and ability to assess AI solutions against operational and member needs.
• Knowledge of ethical AI principles, including bias detection, guardrail validation, and hallucination mitigation.
• Excellent collaboration and communication skills to work across technical teams, business stakeholders, and frontline staff.
• Ability to translate business and regulatory requirements into clear AI testing criteria and validation scenarios.
• Familiarity with analytics, dashboards, automated QA tools, or conversation intelligence platforms used to support testing and monitoring.
• Strong problem-solving skills with the ability to identify systemic quality issues and propose scalable solutions.
• Attention to detail and high standards when reviewing AI outputs, workflows, and system changes.
• Understanding of UX and conversational design principles as they relate to testing and validation.
• Ability to manage multiple priorities in a fast-paced, innovation-driven environment.
• Strong organizational skills and ability to work independently with minimal supervision.
• Ability to work in a team environment with strong collaborative skills.
• Superior interpersonal skills; ability to get along with diverse personalities; tactful, mature, flexible, respectful.
• Flexibility to shift resources and priorities as required.

Requirements

• Bachelor’s degree required in a relevant field such as Information Systems, Computer Science, Business Administration, or a related discipline.
• Equivalent combination of education and directly applicable work experience may be considered, particularly in AI QA, software testing, or risk-focused roles.
• 3–7 years of experience in quality assurance, testing, or validation roles involving complex systems, with at least 2 years focused on AI, conversational AI, or automation platforms required.
• Demonstrated experience leading test planning, execution, defect management, and UAT for enterprise solutions required.
• Expertise in quality assurance methodologies, test planning, test execution, defect tracking, release validation, and vendor correction loops required.
• Experience testing AI systems for accuracy, edge cases, failure modes, and unintended behavior required.
• Strong experience leading UAT efforts and serving as the final approval authority for production releases required.
• Experience testing AI or automated decision systems, including generative AI or NLP-based solutions, strongly preferred.
• Experience partnering with AI engineers, solutions architects, product owners, or business leaders to ensure quality and risk alignment preferred.
• Background in financial services, credit unions, banking, or other regulated environments is a plus.

Benefits

• No-cost employee Medical, dental, vision coverage
• Prescription benefits (including mail order)
• Paid holidays and Paid Time Off (PTO)
• 401(k) plan with contribution matching
• Paid community involvement volunteer hours
• Paid group life insurance
• Teammate loan discounts
• Tuition reimbursement
• Short and long-term disability
• Health & Wellness program
• Teledoc (physician video conferencing)
• Onsite fitness facilities or health club reimbursement
• Employee Assistance Program (EAP)
• Medical flexible spending account
• Dependent care flexible spending account