J
JobQuip
ES
Retour aux offres

AI Benchmark Engineer | Native Language Specialist - Chinese Mandarin - Remote

Lilt ProductionChina (Remote)Salaire à discuterContrat

Description

ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failu

Postuler

Publié 22/04/2026
Candidature verrouillée

Inscrivez-vous pour voir l'offre complète et postuler

Créez un compte gratuit pour ouvrir la candidature, enregistrer l'offre et suivre votre progression.