MogiClera
Founding Engineer, Environments + Data
On-siteFull-time
$200,000 to $300,000 a year
About the job
ABOUT THE ROLE Build evaluation environments and benchmarks that measure whether AI agents can perform real company work and meet or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, helping establish reliable evidence of agent competence. WHAT YOU'LL DO - Design synthetic company environments with realistic email, records, and files for agents to use over extended periods. - Create robust graders and evaluation systems for assessing advanced AI agents. - Develop benchmarks that correlate with real-world production performance. - Identify and address evaluation failures, including reward hacking and benchmark gaming. -...