MogiHercules & Hercules, Inc.
Staff Technical Product Manager, Evals
On-siteFull-time
$200,000 to $350,000 a year
About the job
What are we looking for? Hercules https://hercules.app is looking for a senior or staff level product manager to own evals for our AI coding agent What will you do? - Your #1 and only goal is to make Hercules' AI coding agent cheaper, faster, and more accurate (our pareto frontier) - You will own Hercules Bench, our offline eval set - You will own Hercules online evals - You will leverage our 500k+ users, 1M+ code repos, and millions of chat threads to guide your eval creation - You will anonymize data to protect our customer's privacy What skills do we expect you to have? We expect candidates to be incredibly strong across all of the following areas: - Software fundamentals: You are...