Audit Industry Benchmark Reports for Bias and Missing Data
This prompt analyzes industry reports to identify cherry-picked metrics, hidden survivorship bias, and missing control group data that undermine statistical validity.
Prompt
Act as a data auditor and research analyst. I will provide an industry benchmark report or a summary of its findings. Your goal is to critically evaluate the claims for statistical rigor. Follow these rules: 1. Identify all metrics presented and cross-reference them against implicit missing denominators or baseline controls. 2. Flag potential survivorship bias where only successful entities are included. 3. Highlight timeline gaps or non-standard reporting periods that skew results. 4. State if the report lacks a clear definition of the sample size and selection criteria. Output format: 1. Executive Summary of Findings. 2. Table with columns: Claimed Metric, Potential Omission, Risk Level. 3. List of 3 questions to ask the report author to clarify validity. This is not professional financial or legal advice; consult a qualified professional for investment or business decisions.Example output
Tips and common edits
Why this works
- Forces identification of missing denominators which are often hidden in marketing reports.
- Uses a structured table to force a clear comparison between claims and potential risks.
- Requires explicit questioning of the author to close information gaps.
Use this with Perplexity or ChatGPT when you need to verify marketing-heavy industry reports or white papers. Paste the text of the report or upload the PDF directly after entering the prompt.
Common edits
- Add a specific instruction to check if the report's source data is proprietary or publicly verifiable.
- Adjust the risk level assessment criteria to align with your specific industry standards.
Make it repeatable
Keep using this prompt without pasting it in every time.
Prompt details
- By
- Prompts-GPT editors
- Published
Did this prompt work?
Keep exploring
More like this
Audit Statistical Reporting Integrity in Empirical Research Papers
Reviews reported statistical values in research papers to catch internal inconsistencies, test-statistic mismatches, and signs of p-hacking.
Audit Qualitative Interview Transcripts for Researcher Bias
Get a turn-by-turn bias audit of your interview transcript, a list of contaminated participant quotes to exclude from coding, and neutral rewrites for every leading question.
Red-Team a Research Proposal for Confounders and Failure Modes
Get a severity-ranked validity audit table that exposes confounding variables, sampling biases, and failure modes in your research proposal with concrete fixes.
Design a Pre-Registration Study Protocol with Statistical Rules
Create a rigorous, pre-registered study protocol that defines primary endpoints, exclusion criteria, power calculations, and interim analysis stopping rules to prevent bias.
Grade Whitepaper Claims on Evidence Quality and Bias
Audits specific empirical claims in whitepapers across four objective criteria and assigns an aggregate confidence tier.
Turn a Broad Strategic Question into a Falsifiable Research Plan
Convert a vague strategic question into competing hypotheses, disconfirming tests, minimum-viable data sources, and pre-committed decision thresholds.
- Draft an Institutional Review Board Ethical Risk Assessment
- Synthesize Conflicting Systematic Reviews into an Executive Consensus Map
- Standardize Observational Datasets into a Unified Data Dictionary
- Build a Citation-Verified Policy Brief From Pasted Primary Sources
- Deconstruct Graduate Thesis Topics into Falsifiable Hypotheses
- Fact-Check a Viral Claim With Primary Sources and a Confidence Rating