[Hiring] Research Scientist @Kled AI

Role Description

Research Scientist - Benchmarks & Evals

AI labs buy data when a benchmark shows it works. You’ll build the benchmarks that show what one of the largest human data networks in the world can do for frontier AI models.

• Design and ship public benchmarks for image, video and document models
• Build private test sets from real, opt-in data that no model has trained on
• Run data-value experiments: train models with and without Kled data, measure what changes
• Design human evaluation studies and the automatic metrics that track them
• Publish leaderboards and reports that researchers at frontier labs trust
• Find where models fall short and tell our team what data to collect next
• Work directly with the founders and lab buyers to turn results into data deals

Qualifications

• 3+ years ML research or research engineering experience
• A benchmark or evaluation you built that other people actually used
• Strong hands-on experience training and fine-tuning image or video models (PyTorch)
• Deep understanding of experimental design and statistics (controls, ablations, human studies)
• Experience running experiments end to end, from GPUs to final report
• Clear writing for both researchers and buyers

Requirements

• Bonus: Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially)
• Experience on an evaluation or data team at an AI lab
• Experience selling or licensing data to AI labs
• Experience with data valuation or data attribution research

Benefits

• Base salary: $150,000 - $250,000
• $350,000 – $750,000 equity

Growth Opportunity

You’ll join a team operating at the frontier of applied AI data infrastructure. In this role, you’ll have the opportunity to:

• Own core systems that power one of the largest human data networks in the world
• Design infrastructure that directly influences what data trains next-generation AI models
• Build at real scale - millions of uploads per day, adversarial environments, global contributors
• Ship alongside a team that has built marketplaces, AI systems, and products used by millions