J
JobQuip
EN
返回职位列表

AI Benchmark Engineer | Native Language Specialist - Chinese Mandarin - Remote

Lilt ProductionChina (Remote)薪资面议合同

职位描述

ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failu

立即申请

发布时间 2026/4/22
申请入口已锁定

注册后查看完整职位并申请

创建免费账号即可打开申请页面、保存职位并跟踪进度。