Check an argument for cherry-picked statistics

Spot misleading metrics, absent base rates, and omitted counter-evidence in persuasive text. Use it to verify articles, pitches, and social media debates before believing them.

You getCore Claim, omitted Context and critical Questions to Ask

Prompt

Prompt
Act as an analytical fact-checker and statistical auditor. Analyze the provided text for cherry-picked data, missing baselines, and selective context.

- Flag isolated numbers that lack total population size, sample size, or time horizons.
- Identify missing base rates, control groups, or survivorship bias.
- State the most plausible alternative explanations that the numbers ignore.
- Note what specific external data would confirm or debunk the claim.

Output format:
1. Core Claim (1 sentence)
2. Omitted Context (bullet points detailing missing denominators or baselines)
3. Critical Questions to Ask (3 targeted questions to test the argument)
4. Risk Rating (Low, Medium, or High risk of being misleading, with a 1-sentence reason)

Here is the text to analyze:

Example output

Example for: a promotional post claiming a startup tripled its enterprise revenue

  1. Core Claim
    The company claims exceptional commercial traction by tripling its enterprise customer revenue over the past twelve months.
  2. Omitted Context
  • Denominator missing: Growing 300% could mean going from $5,000 to $15,000, which is negligible for enterprise software.
  • Churn ignored: The text only reports new bookings and ignores client cancellations or net revenue retention.
  • Time baseline: The starting comparison period might have been unusually depressed due to internal restructuring or seasonal dips.
  1. Critical Questions to Ask
  • What was the absolute dollar revenue at the beginning versus the end of this period?
  • How many distinct paying enterprise logos make up this total revenue figure?
  • What was the customer retention rate during the identical twelve months?
  1. Risk Rating
    High risk of being misleading, because percentage gains without absolute numbers or retention metrics routinely mask fragile early-stage performance.
Written by AI from this prompt. Your results will vary.

Paste any article excerpt, sales pitch, or opinion piece directly after the prompt in ChatGPT, Claude, or Gemini. As a follow-up, ask the model to rewrite the claim using fair, balanced phrasing.

Make it repeatable

Keep using this prompt without pasting it in every time.

Keep exploring

More in Critical Thinking & Decisions
Critical Thinking & Decisions

Draft a calm devil's advocate brief

Create structured, non-defensive questions to stress-test popular proposals. Use this to surface blind spots in upcoming team discussions without sounding confrontational.

Critical Thinking & Decisions

Set upfront kill criteria for new initiatives

Establish measurable off-ramps and stop conditions before launching a project. Use this to protect budget and team focus from the sunk cost fallacy.