[Hiring] AI Innovation Quality Assurance - Prompt Team @SitusAMC

Role Description

This role is responsible for defining, executing, and continuously improving quality assurance standards for AI-driven solutions across the Artificial Intelligence Innovation department. This role ensures that AI-generated outputs meet clearly defined expectations for accuracy, consistency, completeness, and explainability prior to and following deployment. This role serves as a Subject Matter Expert (SME) for AI output quality, partnering closely with prompt design, delivery, product, and business teams to embed output-level quality evaluation throughout the AI lifecycle. They will oversee QA Analysts and coordinate with leaders across the Artificial Intelligence Innovation department and business to forecast timelines and ensure timelines are met.

• Define, execute, and continuously improve quality assurance standards for AI agent and prompt outputs, ensuring generated responses meet expectations for accuracy, consistency, completeness, and explainability.
• Oversee QA activities throughout the AI lifecycle, including pre-deployment validation and post-deployment output monitoring (regression testing).
• Ensure AI outputs support informed decision-making by validating clarity, applicability, and alignment with intended business value.
• Serve as an advocate for high-quality AI outputs, promoting shared understanding of output standards and expectations across the organization.
• Lead and oversee QA Analysts responsible for reviewing and evaluating AI agent and prompt outputs.
• Provide direction, coaching, and prioritization to ensure consistent application of output QA standards and timely completion of QA activities.
• Forecast QA timelines and capacity in coordination with AI leadership to support delivery commitments and ensure deadlines are met.
• Coordinate cross team to align QA activities with delivery timelines and ensure prompt and agent readiness.
• Assist with the development of repeatable AI output evaluation approaches that can be applied across use cases to drive efficiency and consistency.
• Document QA findings, trends, and recurring issues related to AI agent and prompt outputs.
• Prepare reports, summaries, and presentations for management outlining QA results, risks, and improvement opportunities.
• Identify opportunities to improve QA processes, tools, and standards based on observed output behavior and delivery feedback.
• Other activities as may be assigned by your manager.

Qualifications

• Bachelor’s degree in a relevant field (such as Business, Computer Science, Data Science, Engineering, or related discipline), or equivalent combination of education and experience.
• Minimum of 6+ years of industry and/or relevant experience, typically with 1+ years in a Senior Associate level role or external equivalent.
• 8+ years of relevant professional experience, with demonstrated involvement in AI, analytics, content evaluation, automation, or quality assurance disciplines.
• Prior QA management experience preferred, including oversight of analysts or reviewers responsible for evaluating outputs or deliverables.
• Prior leadership experience preferred, with the ability to coordinate work, forecast timelines, and drive accountability across teams.
• Demonstrated experience evaluating AI-generated outputs, including prompts, agent responses, or decision-support content.
• Strong understanding of how prompt design, instructions, and context influence AI agent behavior and output quality.
• Excellent written and verbal communication skills, with the ability to explain quality findings and recommendations to both technical and non-technical stakeholders.
• Strong analytical and critical thinking skills, with attention to patterns, edge cases, and systemic quality issues.
• Experience working in Agile or delivery-oriented environments, coordinating priorities across multiple stakeholders.
• Real estate, mortgage, or financial services experience preferred, but not required.
• A strong commitment to integrity, professionalism, and the organization’s guiding principles.

Benefits

• The annual full time base salary range for this role is $110,000.00 - $130,000.00.
• Specific compensation is determined through interviews and a review of relevant education, experience, training, skills, geographic location and alignment with market data.
• Certain positions may be eligible to receive a discretionary bonus as determined by bonus program guidelines, position eligibility and SitusAMC Senior Management approval.
• SitusAMC offers PTO and paid holidays, the terms of which are set forth in the program policies.
• All full time employees also are eligible to participate in various benefit plans, including medical, dental, vision, life, disability insurance and 401K; in each case in accordance with the terms of the applicable plans.

Company Description

SitusAMC is where the best and most passionate people come to transform our client’s businesses and their own careers. Whether you’re a real estate veteran, a passionate technologist, or looking to get your start, join us as we work together to realize opportunities for everyone, we proudly serve.