This role involves developing self-contained terminal tasks, expert solutions, and grading criteria to evaluate AI agents on Earth science workflows and scientific computing. Applicants need a Ph.D., postdoctoral experience, or equivalent advanced background in Earth sciences, along with strong programming skills in languages such as Python, R, Bash, or Julia. The position is a worldwide remote five-week contract requiring at least 40 hours per week with four hours of Pacific Time overlap.