Critique research proposals for methodology and validity gaps

Expose weak controls, feasibility traps, and unstated assumptions in your dissertation or grant proposal before committee review.

You getCore Conceptual Vulnerabilities, methodological & Validity Stress-Tests and three tough questions the defense committee will likely ask

Prompt

Prompt
Act as a critical dissertation committee member reviewing a research proposal.
- Scrutinize the text specifically for internal validity threats, confounding variables, sample selection bias, and unstated operational assumptions.
- Identify potential points of failure in data collection timelines, participant recruitment, or instrument sensitivity.
- Suggest one concrete diagnostic test, pilot experiment, or statistical control for every identified risk.
Output format:
1. Core Conceptual Vulnerabilities (bulleted critique with specific failure modes).
2. Methodological & Validity Stress-Tests (table with columns: Identified Threat, Risk Level, Recommended Countermeasure).
3. Three tough questions the defense committee will likely ask.

Here is my proposal summary and methodology:

Example output

Example for: an educational technology proposal measuring AI tutoring impact in high schools

1. Core Conceptual Vulnerabilities
  • Novelty Effect Bias: Student engagement may spike during the four-week intervention simply due to the tool's novelty rather than improved pedagogical efficacy, leading to inflated short-term score gains.
  • Uncontrolled Teacher Variance: While the software is standardized, differing classroom instructor attitudes toward technology introduce an unmeasured confounding variable.
  • Attrition Risk: Relying on voluntary post-test participation across five partner schools introduces severe self-selection bias toward already motivated students.
2. Methodological & Validity Stress-Tests
Identified ThreatRisk LevelRecommended Countermeasure
Attrition BiasHighTrack non-completion demographics and apply inverse probability weighting or bounds analysis rather than discarding incomplete records.
Hawthorne EffectMediumIntroduce an active control group using traditional digital workbooks to isolate software interaction from genuine instructional feedback.
Ceiling Effects in AssessmentMediumPre-screen benchmark test instruments to ensure question difficulty items discriminate sufficiently between upper-quartile performers.
3. Likely Committee Defense Questions
  1. "How will you disentangle the instructional impact of the software from baseline pedagogical differences among the participating teachers?"
  2. "What statistical power justification supports your assumption that a four-week intervention is sufficient to detect durable comprehension gains?"
  3. "If attrition exceeds 20% in lower-performing student clusters, how will your analysis defend against systematic survivorship bias?"
Written by AI from this prompt. Your results will vary.

Paste your proposal abstract, research questions, and methodology section into ChatGPT, Claude, or Gemini. As a follow-up, paste your proposed data collection timeline to stress-test your operational feasibility.

Make it repeatable

Keep using this prompt without pasting it in every time.

Keep exploring

More in Academic Writing & Study
Academic Writing & Study

Prepare for tough thesis defense questions

Pressure-test your thesis manuscript against skeptical committee members before your defense. Uncover methodology flaws, scope issues, and hidden assumptions.