Evaluating AI Output

By LessonFolk

Theme: Using AI toolsLevel: Intermediate

How to tell whether a prompt, a model or an AI tool is really good — define what "good" means, understand what makes a solid test set, score answers with checks, people and AI judges, and catch problems when something changes. No code needed.

About 1.5 hours 6 lessons

Before this course

This course builds on:

Lessons

  1. Why "it looked fine" is not enough

    About 15 min

  2. Defining what good means

    About 15 min

  3. What makes a good test set

    About 15 min

  4. Scoring: checks, people and AI judges

    About 15 min

  5. Comparing versions and catching regressions

    About 15 min

  6. Evaluating in real use

    About 15 min