This part-time, remote contract role involves designing and evaluating realistic software engineering benchmark tasks to test coding agents on safety, privacy, and utility. Candidates worldwide must have English fluency, Python expertise, proficiency in Java, Go, or C++, and at least eight years of hands-on software engineering experience. A minimum commitment of 20 hours per week is required.