Bilingual Evaluator - Internet Culture Expert

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Internet-Native Bilingual Evaluator Expert (Spanish – Latin America)

Type: Contract

Compensation: $25/hour

Location: Remote

Commitment: 10–20 hours/week

Role Responsibilities

• Evaluate AI model outputs across English and Spanish to ensure accuracy in modern online communication, cultural references, and multilingual interactions.
• Analyse content from social media, forums, and online communities for naturalness, fluency, and cultural appropriateness.
• Identify issues with slang, memes, abbreviations, and evolving online language specific to Latin American internet culture.
• Develop detailed rubrics and guidelines for evaluating bilingual and internet-native communication.
• Test language models using real-world multilingual prompts and provide structured feedback to improve model performance.
• Collaborate with project leads to maintain consistency across datasets and improve evaluation frameworks.

Qualifications

Must-Have

• Native or near-native fluency in Latin American Spanish and professional fluency in English.
• Deep familiarity with internet culture and online communities in Spanish-speaking countries in Latin America.
• Active engagement with platforms like YouTube , TikTok , Reddit , Discord , Instagram , Twitch , Facebook , and WhatsApp .
• Strong understanding of Latin American Spanish slang, memes, and digital culture.
• Strong writing, analytical, and critical thinking skills.

Preferred

• Experience in content moderation, localisation, translation, linguistics, social media, journalism, or AI evaluation .
• Familiarity with regional linguistic differences across Mexico, Argentina, Colombia, Chile, Peru, and other Spanish-speaking countries.
• Experience evaluating user-generated content or digital communications.
• Interest in AI , language models, and internet culture research.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to: Mostrar correo electrónico

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.