Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

ClaudeClaude

Evals for taste: Hill-climbing a slide-generation agent

Built rubric-driven replayable eval system from real user projects giving quality, cost, latency, error, token signals in under 6 hours per model change. Evolved into dev flywheel powered by real user dissatisfaction signals.

May 23, 202639mWatch on YouTube

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Great conversations run long. Their best ideas don't have to.

uListen is free on iPhone, iPad, Android, Chrome, and Claude.

See how

Episode Details

EPISODE INFO

Released
May 23, 2026
Duration
39m
Channel
Claude
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

Built rubric-driven replayable eval system from real user projects giving quality, cost, latency, error, token signals in under 6 hours per model change. Evolved into dev flywheel powered by real user dissatisfaction signals.

EPISODE SUMMARY

In this episode of Claude, Evals for taste: Hill-climbing a slide-generation agent explores Building actionable evals to iteratively improve slide-generation agents fast Evals are positioned as the actionable bridge between subjective “vibes” and measurable signals for improving AI agents before issues hit production.

RELATED EPISODES

Ship your first Managed Agent

Ship your first Managed Agent

Tool, skill, or subagent? Decomposing an agent that outgrew its prompt

Tool, skill, or subagent? Decomposing an agent that outgrew its prompt

Agent Battle: Mine the most diamonds in 45 minutes

Agent Battle: Mine the most diamonds in 45 minutes

Agents that remember

Agents that remember

How we Claude Code

How we Claude Code

Making agentic workflows trustworthy and verifiable with a custom DSL

Making agentic workflows trustworthy and verifiable with a custom DSL

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.