Agent Evals Guides and Tutorials
2 guides about Agent Evals, newest first. The first one published was “AI Agent Evaluation Framework: Claude Code Eval Loop Steps”. Last updated .
· 19 min read
AI Agent Evaluation Metrics: Pass Rate Across Repeat Runs
AI agent evaluation metrics for Claude Code: compute pass@k, pass^k, variance across N reruns and judge-score drift to catch flaky or silently wrong runs.
· 18 min read
AI Agent Evaluation Framework: Claude Code Eval Loop Steps
An AI agent evaluation framework for Claude Code: write tasks and graders, run each several times, and track pass rate and pass^k. Includes a harness.