Week 10: Evaluating agents

Back to schedule

First session (lecture)

Can the check fail, was the pass earned, is the denominator complete; pass@k on a small table; calibrating a model judge.

Second session

Studio: audit one instance.

Due

A6

Materials

The current lesson materials are available below. Generate first, then verify the result.

• Week guide
• Notes
• Slide source
• Activities
• Self-check
• Answer guidance
• Readings