
The Stack
How to — build a small eval set for your own AI feature
You changed a prompt, and now you can't tell whether the feature got better or you just remembered the good answers. An eval set is how you stop guessing: a fixed batch of real cases with a written pass mark, run again every time you touch anything. You can build a usable one in an afternoon. There is nothing ceremonial about this. A good eval for a product team is 30 to 100 real cases, each with a short statement of what a pass looks like, kept in a file that gets re-run. The public leaderboar










