[Hiring] Web Research Task Author @Careerflow.ai

Role Description

You'll create research tasks that evaluate how well AI systems can find verifiable answers across the open web. Each task requires synthesizing multiple independent clues from public English sources, each supported by exact quotes. Your work is tested against frontier models and reviewed for rigor—only tasks with bulletproof sources and appropriate difficulty count. Remote, contract position; approximately four hours per completed task.

Key Responsibilities

• Craft a 60–120 word prompt that feels like a genuine question—original phrasing, no copied content, no search hints.
• Research four to six clues across different reputable open English sources (excluding Wikipedia and paywalled content), each with a direct quote, URL, and verification date.
• Identify a definitive answer (name, date, catalogue number, or documented title) and clearly explain why alternatives don't fit.
• Document plausible wrong answers and which clue eliminates each; articulate your search path.
• Verify all sources while logged out; refine tasks that models solve too easily or that reviewers find unclear.

Qualifications

• 3+ yrs of experience with Masters Degree
• Advanced web research: search operators, reverse lookups, direct access to institutional catalogues and databases.
• Familiarity with archives and catalogues: libraries, museums, legislative and court records, registers, specialized databases (sports, film), Wayback Machine, preprint servers.
• Strong source evaluation: distinguishing primary from secondary sources, open from restricted, original from republished, stated facts from implications.
• Precise citation: pulling verbatim text from web pages, PDFs, scans, and tables—typos included.
• Clue architecture: designing constraints that are individually searchable yet jointly pinpoint the answer; identifying logical chains, information leaks, and undefined terms.
• Clear, fluent written English.
• Comfort using search engines and LLM tools—with a commitment to fact-checking every AI-generated claim against the actual source.

Requirements

• Demonstrated sourced research background: journalism or fact-checking, library/archival work, genealogy, due diligence, graduate-level primary-source research, or citation-heavy editing.
• Availability: 20+ hours per week, any time zone; NDA required (materials are confidential client IP).

Nice-to-have

• Deep expertise in history, science/technology, sports, music, politics, geography, film, or television.
• OSINT or cataloguing experience.
• Prior work creating benchmarks, exams, or puzzle content.

Application & Selection Process

• Submit the Interest Check Form (ICF).
• Complete the Vetsmith Assessment. Please review the assessment guidelines provided at the end of the assignment document before starting.
• Proceed to the Delivery Manager Review.

Project Snapshot

• 3+ years of professional experience
• Total number of positions: 320
• Engagement Length: 4 weeks, Full-time (8 hours/day) 40 hours per week. Overlap 4 hours with PST
• Location: Bangladesh, Brazil, Colombia, Egypt, Nigeria, Ghana, India, Indonesia, Turkey, Vietnam
• Estimated earning potential of approximately $30 per approved task, based on the current task mix.
• 6-week project, with a preferred commitment of up to 40 hours per week.
• Fully remote, with payment in USD.
• Start as soon as you successfully pass the assessment.