Evaluate study methodology for flaws and limitations

Identify methodological weaknesses, confounding factors, and sample size limitations in published research.

You getMethodology Overview, critical Weaknesses and confounding Variables

Prompt

Prompt
Act as an academic research methodologist. Review the pasted study excerpt to detect methodological flaws, confounding variables, and unsupported conclusions.

Rules:
- Check sample size adequacy, selection bias, attrition, and control group validity.
- Identify whether correlation is improperly reported as causation.
- Highlight missing data or undisclosed external variables.
- Provide general educational analysis only, not formal academic peer review.

Output format:
- Methodology Overview: 2-3 sentence summary of the study design.
- Critical Weaknesses: Bulleted list of methodological flaws, each paired with why it impairs validity.
- Confounding Variables: Table with columns Variable, Likely Impact, and How to Control.
- Conclusion Reliability: A rating of Low, Moderate, or High with a short rationale.

Here is the study excerpt:

Example output

Example for: a workplace wellness study linking meditation apps to sales performance

Methodology Overview

The authors conducted a four-week observational study evaluating whether daily use of a guided meditation app correlated with higher quarterly sales revenue across 42 voluntary enterprise account executives. No randomized control group was implemented.

Critical Weaknesses
  • Self-Selection Bias: Participants opted in voluntarily, meaning participants likely possessed higher baseline motivation, discipline, or existing wellness habits than colleagues who declined.
  • Small Sample Size: A sample of 42 employees across different product lines provides insufficient statistical power to isolate software usage from routine sales variance.
  • Short Duration: Four weeks is too short to account for standard B2B enterprise sales cycles, which typically range from three to nine months.
Confounding Variables
VariableLikely ImpactHow to Control
Inbound Lead QualitySkews individual sales performance regardless of wellbeingRandomly assign incoming leads across both cohorts
Territory SenioritySenior reps close larger deals irrespective of app usageStratify cohorts by historical quota attainment
Seasonal Demand End-of-QuarterPushes reps to close deals due to existing pipeline maturityTrack performance year-over-year instead of single-month
Conclusion Reliability

Low. The study demonstrates an observational correlation between engaged employees and closed revenue, but fails to isolate the app intervention from underlying sales dynamics.

Written by AI from this prompt. Your results will vary.

Paste an abstract, methodology section, or research summary right after the prompt into ChatGPT, Claude, or Gemini. For deeper scrutiny, ask the model to draft three critical questions to raise during a journal club discussion.

Make it repeatable

Keep using this prompt without pasting it in every time.

Keep exploring

More in Research