Bilingual Evaluator - Fully Remote | Upto $50/hr

Role Summary

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

• Position: Dutch Audio Generalist Evaluator Expert
• Type: Contract
• Compensation: $50/hour
• Location: Remote
• Duration: 3–6 months
• Role Responsibilities

Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions.

Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English .

Conduct model testing by running prompts and assessing outputs against expectations.

Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.

Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Requirements

• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Fluent in Dutch and English
• Able to work within GMT or PST working hours

Preferred

• College students or graduates
• Application Process (Takes 20–30 mins to complete)
• Complete an AI-led interview (approximately 15 minutes)
• If selected, you will be invited to work on the project
• Resources & Support
• For details about the interview process and platform information, please check:

Additional Information

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.