← AI AgentsLesson 6 of 10

Systems · 14 min

Eval before demo

Jules’s bar: if the eval does not replay raw tool JSON, you missed the incident. Golden transcripts beat vibe checks.

Score tool choice, argument validity, and stop behavior separately. A fluent summary of a wrong tool call is a double miss.

Run the eval on the last production trace, not only the lab set.