[Hiring] VBT Task Author @Careerflow.ai

Role Description

We are seeking an analytical researcher and red-teaming specialist to build evidence-based web-research benchmark tasks that reliably expose weaknesses in state-of-the-art (SOTA) AI models (e.g., Claude Opus 5 Max). In this role, you will:

• Discover hard-to-surface facts.
• Build precise research tasks around them.
• Test them directly against leading LLMs.
• Diagnose the exact failure mechanisms in the model's search and reasoning paths.

Your work will directly shape AI evaluation frameworks, ensuring next-generation frontier models are tested against rigorous, non-trivial real-world research scenarios.

Qualifications

• Bachelor or higher degree from relevant engineering domain.
• Prior experience specifically designing prompt-injection or reasoning-trap tasks that break SOTA models.
• Advanced OSINT capabilities or published investigative/academic research demonstrating deep source verification.

Requirements

• Core Experience: 1+ years in investigative research, fact-checking, AI benchmark task authoring, red-teaming, or technical QA review.
• Benchmark Familiarity: Proven experience authoring, testing, or reviewing tasks for AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity’s Last Exam (HLE).
• Analytical & OSINT Skills: Intermediate-to-advanced web search and Open Source Intelligence (OSINT) skills; ability to navigate academic archives, local records, or obscure databases.
• Model Trajectory Debugging: Strong analytical capability to inspect model reasoning chains, search logs, and source selection to diagnose root causes of failure.
• Precision Writing: Ability to author clear, unambiguous benchmark prompts with bulletproof, primary-sourced answer keys.

Benefits

• Engagement Length: 4 weeks, Full-time (8 hours/day) 40 hours per week.
• Overlap: 4 hours with PST.

Location

• Bangladesh
• India
• Indonesia
• Egypt
• Ghana
• Nigeria
• Turkey
• Brazil
• Colombia

Total number of positions

180