[Hiring] Measurement & Insights Lead @We Are Rosie

Role Description

This role owns the measurement and insights infrastructure behind the AEO program. You'll build and maintain the prompt panel used to test how the brand shows up in AI-generated answers, evaluate the tools that support it, run quality assurance on the responses that come back, and turn all of it into dashboards and experiment analysis the team can act on. The core question you're answering: when someone asks an AI platform about this category, does the brand show up, how is it described, and what makes that change.

You'll own the measurement system end to end, from designing what gets tracked, to auditing the quality of what comes back, to building the reporting layer that makes results legible to non-technical stakeholders. The job takes equal parts rigor and communication. Sound experiment design and consistent QA on one side, clear and usable findings on the other.

This is a new category, so the measurement approach doesn't fully exist yet. You'll be building it, and some of it you'll figure out as you go.

• Building and maintaining a structured prompt panel to test and track brand visibility and citations across AI platforms.
• Evaluating and recommending tools for prompt panel management, response capture, and analysis.
• Running quality assurance on response data, flagging inconsistencies, tool errors, or gaps that would compromise the accuracy of findings.
• Designing and building dashboards that make performance and trends clear and actionable for both agency and client stakeholders.
• Designing and running experiments to test hypotheses and isolate what actually drives changes in visibility.
• Analyzing experiment and panel results and translating findings into clear recommendations.
• Documenting measurement methodology and QA processes so the system is repeatable, defensible, and can transfer to the client team over time.
• Partnering with agency and client stakeholders to align on what's being measured and why, and socializing findings as needed.

Qualifications

• Hands-on experience measuring AI search or AEO/GEO performance: prompt testing, citation and share-of-voice tracking, or LLM response analysis.
• Experience building and maintaining measurement or reporting systems (dashboards, tracking panels, or similar) in an analytics or research context.
• Strong data QA instincts. You're comfortable auditing outputs for accuracy and catching errors before they reach a report.
• Experience designing and analyzing experiments, whether A/B testing or similar comparative analysis.
• Proficiency with dashboarding and BI tooling, and comfort working with structured data.
• Clear written and verbal communication for translating technical findings into recommendations non-technical people can use.

Requirements

• Background at an agency or platform delivering AEO or GEO as a service.
• Technical SEO experience, particularly around structured data and content structuring for retrieval.

Benefits

• Start Date: October 1st
• Length: 8 months
• Hourly Rate: $150 (based on experience)
• Location: Remote
• Hours: 40 hours/week