What to measure before you launch an agent
Separate task success, mistakes, time and cost before you build a leaderboard.
Field notes
Search the field notes
3 results tagged evaluation
Page 1 of 1
Give agents a clear stopping point
Completion should be observable, and retries should have limits.
Compare models on the same work
Keep inputs and evaluation consistent when choosing a model.