J
JobQuip
VI
Kembali ke lowongan

AI Benchmark Engineer | Native Language Specialist - Chinese Mandarin - Remote

Lilt ProductionChina (Remote)Gaji bisa dinegosiasikanKontrak

Deskripsi

ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failu

Lamar sekarang

Dipublikasikan 22/4/2026
Lamaran terkunci

Daftar untuk melihat detail lengkap dan melamar

Buat akun gratis untuk membuka halaman lamaran, menyimpan lowongan, dan memantau progres.