Audit Statistical Reporting Integrity in Empirical Research Papers
Reviews reported statistical values in research papers to catch internal inconsistencies, test-statistic mismatches, and signs of p-hacking.
You getSummary Table, integrity Flags and verification Notes
Prompt
Act as a quantitative peer reviewer and meta-science researcher. Your job is to audit the statistical reporting in an empirical results section. I will paste an excerpt containing inferential statistics (such as t-tests, ANOVA, regression coefficients, confidence intervals, or sample sizes).
Rules:
1. Check internal consistency between test statistics, reported degrees of freedom, sample sizes, and p-values (e.g., whether a stated t-statistic and df mathematically produce the reported p-value).
2. Flag any signs of selective reporting or p-hacking, such as p-values clustered suspiciously between 0.041 and 0.049, missing baseline degrees of freedom, or unexplained covariate switching.
3. Verify whether 95% confidence intervals align with reported standard errors and point estimates.
4. Do not invent missing data; explicitly label omissions as Unverifiable.
Output format:
- Summary Table: Columns for Reported Test, Stated Values, Recomputed Values, and Status (Consistent, Discrepant, or Missing Parameters).
- Integrity Flags: Bulleted findings detailing exact discrepancies or methodological red flags.
- Verification Notes: One concise note stating missing context or potential benign explanations (e.g., rounding errors, post-hoc corrections).
Please reply with 'Paste your results section text' to begin.Example output
Tips and common edits
Why this works
- Forces mathematical cross-checking between test statistics, degrees of freedom, and reported p-values.
- Specifically targets p-hacking indicators like clustering right below the 0.05 threshold.
- Separates verified calculations from missing parameters so reviewers avoid false accusations.
Paste an empirical results section directly after the initial prompt in ChatGPT, Claude, Gemini, or Perplexity. Works best with t-tests, regressions, and ANOVAs.
Common edits
- Add a requirement to calculate Cohen's d or partial eta squared from the reported raw numbers.
- Instruct the model to account for specific multiple-testing corrections like Bonferroni or FDR adjustments.
Make it repeatable
Keep using this prompt without pasting it in every time.
Prompt details
- By
- Prompts-GPT editors
- Published
Did this prompt work?
Keep exploring
More like this
Red-Team a Research Proposal for Confounders and Failure Modes
Get a severity-ranked validity audit table that exposes confounding variables, sampling biases, and failure modes in your research proposal with concrete fixes.
Audit Industry Benchmark Reports for Bias and Missing Data
This prompt analyzes industry reports to identify cherry-picked metrics, hidden survivorship bias, and missing control group data that undermine statistical validity.
Turn a Broad Strategic Question into a Falsifiable Research Plan
Convert a vague strategic question into competing hypotheses, disconfirming tests, minimum-viable data sources, and pre-committed decision thresholds.
Draft an Institutional Review Board Ethical Risk Assessment
Generate a comprehensive ethical risk assessment for field research studies to ensure compliance with Institutional Review Board standards for participant safety and data privacy.
Synthesize Conflicting Systematic Reviews into an Executive Consensus Map
This prompt organizes conflicting research findings into a clear map of consensus and debate, helping you identify where evidence is strong versus uncertain.
Grade Whitepaper Claims on Evidence Quality and Bias
Audits specific empirical claims in whitepapers across four objective criteria and assigns an aggregate confidence tier.
- Literature Review Matrix From Pasted Paper Abstracts
- Claim Verification Review with Contradiction Log and Confidence Rating
- Audit Qualitative Interview Transcripts for Researcher Bias
- Deconstruct Graduate Thesis Topics into Falsifiable Hypotheses
- Design a Pre-Registration Study Protocol with Statistical Rules
- Standardize Observational Datasets into a Unified Data Dictionary