Verify the Coding Agent's 'Done' Claim Against the Diff and Test Output
Checks each claim in a coding agent's final summary against the actual diff and test runs, marks it verified, unverified or contradicted with evidence, and lists unmentioned changes, skipped tests and stubs.
You getTable, changes the summary does not mention and tests claimed vs actually run
The prompt
mkdir -p .agents/skills/verify-the-coding-agent-s-done-claim-against-the-diff-and-test-o && curl -sL "https://prompts-gpt.com/prompts/verify-the-coding-agent-s-done-claim-against-the-diff-and-test-output/raw" -o .agents/skills/verify-the-coding-agent-s-done-claim-against-the-diff-and-test-o/SKILL.mdYou are a skeptical code reviewer. A coding agent says its task is done. Check every claim in its summary against what actually changed and ran.
Agent's final summary: Done. Added per-user rate limiting (100 req/min) to /api/orders, keyed by user ID. Returns 429 with Retry-After header. Added tests for the limiter. All tests pass. (example value for {paste the agent summary})
If you have repository access (Claude Code, Codex, Cursor or Copilot agent), run git status and git diff against the base branch, and rerun the test command the agent says it ran. Otherwise use the diff and test output I paste after the summary. The summary itself is never evidence.
Rules:
- Split the summary into single claims. Mark each Verified, Unverified or Contradicted and cite the diff hunk (file and line) or log line.
- "Tests pass" counts only if you see output for the full suite, not one file.
- Look for what the summary leaves out: changed files it does not mention; skipped, deleted or weakened tests; to-do comments, stubs, hard-coded values or mocked-out logic; edits to config, CI, lockfiles or secrets.
Output format:
1. Table: claim | status | evidence
2. Changes the summary does not mention
3. Tests claimed vs actually run, with results
4. Risks: stubs, to-do comments, config or secret edits
5. Verdict: merge, fix or redo, with the exact instruction to give the agent next
Say what you could not check.Dashed parts are example values, so the prompt runs as copied. Change them in Fill in the blanks.
Example output
Run in a fresh Claude Code, Codex, Cursor or Copilot session on the agent's branch, or paste the summary, git diff and test log into Claude. Use it before merging any agent PR.
Make it repeatable
Keep using this prompt without pasting it in every time.
Prompt details
- By
- Prompts-GPT editors
- Published
Did this prompt work?
Keep exploring
More like this
Pre-Merge Self-Review of a Git Diff: Correctness, Security, and Test Gaps
Has Claude Code review a branch diff like a skeptical maintainer, producing severity-ranked findings with evidence and a clear merge, fix, or block recommendation. Use it before opening or approving a pull request.
Agent Session Handoff Brief with Resume Checklist and Verified State
Makes Claude Code produce a handoff file capturing goal, verified repo state, decisions, blockers, and exact resume commands so another engineer or agent session can continue without rework. Use it before ending a long task.
Safe Refactor With Characterization Tests and Small Commits
Get a refactor split into small commits, each with its test result, after characterization tests pin what the code does today, plus a list of suspected bugs left unfixed.
Claude Code Repo Recon and Implementation Plan for a New Feature
Has Claude Code inspect a repository read-only and produce an evidence-based implementation plan with file-level changes, tests, risks, and open questions. Use it to decide whether to start, split, or clarify a feature before any code is written.
AGENTS.md Writer: Agent Skill (SKILL.md) for Claude Code, Codex and Cursor
Writes or refreshes a repo's AGENTS.md or CLAUDE.md from what's actually in the code: verified build, test and lint commands, a directory map, conventions, do and don't lists, and gotchas, kept under about 150 lines.
Code Review Checklist: Agent Skill (SKILL.md) for Claude Code, Codex and Cursor
Reviews a diff for correctness, security, performance and tests, and reports findings as file:line with a fix.
- Domain Model And ADRs: Agent Skill (SKILL.md) for Claude Code, Codex and Cursor
- TDD In Vertical Slices: Agent Skill (SKILL.md) for Claude Code, Codex and Cursor
- Verify Before Done: Agent Skill (SKILL.md) for Claude Code, Codex and Cursor
- Write An Implementation Plan: Agent Skill (SKILL.md) for Claude Code, Codex and Cursor
- Root-Cause Bug Fix With a Failing Test and a Minimal Patch
- Conventional Commit and PR Description from a Diff and Ticket