Role Description
We are seeking senior Product Design and AI-Assisted Development Experts to create evaluation tasks for AI systems working across rapid prototyping, product design, and human-AI collaboration. Experts may contribute to either or both tracks:
-
Vibecoding:
AI-assisted software development, natural-language-to-code workflows, and rapid prototyping.
-
Design:
Product design, UX/UI, design systems, component libraries, research, and usability.
No formal credential is required; demonstrated expertise and shipped work are highly valued.
Key Responsibilities
-
Create realistic scenarios covering rapid prototyping, iteration, design systems, and product-design-engineering collaboration.
-
Develop tasks involving AI coding tools such as Cursor, Claude Code, v0, and Replit.
-
Create Design-track tasks using Figma, Framer, prototyping tools, and design-system platforms.
-
Apply prompt-driven development, human-centered design, heuristic evaluation, and rapid prototyping methodologies.
-
Produce reference prototypes, code artifacts, design specifications, and usability evaluation reports.
-
Develop detailed rubrics that distinguish senior-level product judgment from generic or template-driven work.
-
Collaborate on task refinement and evaluation standards.
Qualifications
-
Product Design
-
UX/UI Design
-
Rapid Prototyping
-
Design Systems
-
Vibecoding / AI-Assisted Development
-
Human-Centered Design
-
User Research & Usability Testing
-
Figma / Prototyping Tools
-
Design Critique
-
Product Judgment
-
AI-Assisted Coding
-
Evaluation & Rubric Development
Preferred Qualifications
-
5+ years of experience as a product designer, design lead, or AI-native engineer/vibecoder.
-
Experience at a product- or design-focused company, startup, or notable independent product.
-
Direct ownership of shipped product designs, design systems, or AI-assisted development workflows.
-
Strong fluency with relevant design or AI development tools.
-
Portfolio of shipped work strongly preferred.
-
Experience creating rubrics, training materials, design critiques, or evaluation frameworks is a plus.
Contract & Payment
-
Independent contractor engagement.
-
Fully remote with a flexible schedule.
-
Project duration may vary based on business needs and performance.
-
Weekly payments via Stripe or Wise based on services rendered.
Screening Questions
-
How many years of product design, UX/UI, or AI-assisted development experience do you have?
-
Which track do you specialize in: Vibecoding, Design, or both?
-
What products, design systems, or AI-assisted workflows have you shipped?
-
Which tools do you use regularly (e.g., Figma, Framer, Cursor, Claude Code, v0, Replit)?
-
Do you have a portfolio of shipped work?
-
What experience do you have creating design critiques, rubrics, or evaluation frameworks?
-
How soon can you start?