README.md

Prompt evaluations

Welcome to Anthropic's comprehensive prompt evaluations course. Across nine lessons, you will learn everything you need to know to implement evaluations successfully in your workflows with the Anthropic API. We recommend that you start from the beginning with the Evaluations 101 lesson, as each lesson builds on key concepts taught in previous ones.

Table of contents

1. Evaluations 101
2. Writing human-graded evals with Anthropic's Workbench
3. Writing simple code-graded evals
4. Writing a classification eval
5. Promptfoo for evals: an introduction
6. Writing classification evals with promptfoo
7. Custom graders with promptfoo
8. Model-graded evals with promptfoo
9. Custom model-graded evals with promptfoo