Set up skill evals

October 1, 2026

An eval.md is a simple checklist your skill can run before showing you its work. Most people don’t have this file in their skills, but I’ve found it very useful to include.

I’ll use my /podcast-production skill, which turns a finished episode into newsletter takeaways and other assets, as an example, but you can add an eval to any skill.

1. Turn common mistakes into yes/no eval checks

My early /podcast-production drafts found the right ideas but didn’t include interesting quotes or stats, and the takeaways weren’t specific enough. Those repeated failures became additional instructions and eval checks for the skill.

Open the thread where you use your skill most and look for mistakes you corrected more than once. Then paste this prompt with your skill’s name: