[Hiring] Secretary & Admin Assistant @RemoteJobsOne

Role Description

This is a fully remote position, open to candidates based in Canada.

We are engaging Secretary & Admin Assistants to contribute to a customer's project focused on designing and producing expert-authored evaluation tasks for a frontier AI benchmark. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. This engagement offers the opportunity to simulate authentic administrative challenges, crafting assignments that reflect the complexity and nuance of real-world operations, and directly impact the advancement of intelligent systems.

Scope of Work

• Design realistic, process-driven evaluation tasks that require sophisticated multi-tool coordination (e.g., calendar reconciliation, travel and expense workflows, records management, professional correspondence).
• Create and assemble authentic data artifacts, including emails, calendar entries, receipts, meeting notes, and contact records, to support each evaluation scenario.
• Define correct solutions and map out the step-by-step decisions an expert would take to achieve the best outcome in each scenario.
• Develop comprehensive rubrics (35+ criteria) that assess both process adherence and nuanced judgment calls for AI agent outputs.
• Document workflow processes and suggest improvements that reflect current best practices in the administrative domain.
• Collaborate with project leads to calibrate task complexity and ensure alignment with real-world challenges faced by experienced professionals.

Qualifications

• 5+ years of experience supporting teams or departments within mid-to-large organizations in a professional administrative capacity.
• Demonstrated process ownership and responsibility for ongoing, recurring workflows beyond ad-hoc assignments.
• Expertise in documenting, evaluating, and improving inherited administrative procedures.
• Proficient written and verbal communication skills with a strong command of professional correspondence standards.
• Exceptional attention to detail, ensuring accuracy in both content creation and process documentation.
• Comfort working with a variety of digital tools, platforms, and data formats (CSVs, PDFs, spreadsheets, technical documents).
• Enthusiasm for shaping the future of intelligent systems by sharing domain-specific knowledge and best practices.

Requirements

• Compensation is output-based; experts are paid per task that meets the project specifications.
• The time required to complete work may vary depending on the expert’s experience and workflow.
• Minimum submission requirements apply; experts must submit a minimum of tasks per week.

Benefits

• We typically fill roles within 48 hours and are looking for experts ready to jump in right away.
• If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

How to apply

Apply here with your Indeed profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.