← AI AgentsLesson 6 of 10
Systems · 14 min
Eval before demo
Jules’s bar: if the eval does not replay raw tool JSON, you missed the incident. Golden transcripts beat vibe checks.
Score tool choice, argument validity, and stop behavior separately. A fluent summary of a wrong tool call is a double miss.
Run the eval on the last production trace, not only the lab set.