Bilingual Evaluator - Fully Remote | Upto $50/hr

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Dutch Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Duration: 3–6 months Role Responsibilities • Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions. • Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English . • Conduct model testing by running prompts and assessing outputs against expectations. • Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor. • Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines. Qualifications Must-Have • Strong writing and critical thinking skills • Ability to work independently and meet deadlines • Fluent in Dutch and English • Able to work within GMT or PST working hours Preferred • College students or graduates Application Process (Takes 20–30 mins to complete) • Complete an AI-led interview (approximately 15 minutes) • If selected, you will be invited to work on the project Resources & Support • For details about the interview process and platform information, please check: • For any help or support, reach out to: PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. Originally posted on Himalayas