J
JobQuip
中文
Quay lại việc làm

AI Benchmark Engineer | Native Language Specialist - Chinese Mandarin - Remote

Lilt ProductionChina (Remote)Lương thỏa thuậnHợp đồng

Mô tả

ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failu

Ứng tuyển ngay

Đã đăng 22/4/2026
Đơn ứng tuyển đang khóa

Đăng ký để xem đầy đủ và ứng tuyển

Tạo tài khoản miễn phí để mở trang ứng tuyển, lưu việc và theo dõi tiến độ.