Standardize Observational Datasets into a Unified Data Dictionary
Transforms messy variable lists from multiple research sources into a standardized, ready-to-use tabular data dictionary with harmonized names and types.
You getA Markdown table with these exact columns, under the table and end with a single line titled Limitations & Risks…
Prompt
Act as a research data manager. I will paste raw variable lists, codebook snippets, or schema extracts from two or more observational studies below.
Your job is to reconcile them into a single, cohesive data dictionary.
Rules to follow:
1. Consolidate overlapping concepts under clean snake_case standard variable names.
2. Assign strict data types (integer, float, categorical, boolean, date, or text).
3. Define permissible ranges or accepted categorical levels for each variable.
4. Specify standard null codes (use NA for system missing, -99 for unknown, -98 for refused).
5. Map every standard variable back to its raw source field name.
Output format:
- A Markdown table with these exact columns: Standard Name, Data Type, Valid Range / Allowed Values, Missing Code, Source Field Mapping, Clinical/Operational Definition.
- Under the table, provide a short numbered list titled Harmonization Decisions explaining any unit conversions or conceptual merges.
- End with a single line titled Limitations & Risks detailing potential bias or measurement mismatch between sources.
Paste your raw variable lists or codebook text below this line:Example output
Tips and common edits
Why this works
- Strict table column definitions prevent missing schema details like units, data types, and missing codes.
- Requiring backward mapping to raw field names makes the dictionary immediately actionable for ETL and data wrangling.
- The mandatory harmonization notes force transparency regarding how incompatible categorical scales were merged.
Paste messy variable lists, codebooks, or table schemas from multiple datasets right after the prompt. Works directly in Claude, ChatGPT, Gemini, or Perplexity.
Common edits
- Change the missing code scheme to match specific pipeline standards like IEEE NaN or custom database integer flags.
- Add a column for longitudinal study visits or wave numbers if working with multi-year panel datasets.
Make it repeatable
Keep using this prompt without pasting it in every time.
Prompt details
- By
- Prompts-GPT editors
- Published
Did this prompt work?
Keep exploring
More like this
Red-Team a Research Proposal for Confounders and Failure Modes
Get a severity-ranked validity audit table that exposes confounding variables, sampling biases, and failure modes in your research proposal with concrete fixes.
Turn a Broad Strategic Question into a Falsifiable Research Plan
Convert a vague strategic question into competing hypotheses, disconfirming tests, minimum-viable data sources, and pre-committed decision thresholds.
Deconstruct Graduate Thesis Topics into Falsifiable Hypotheses
Convert a broad research interest into three distinct, falsifiable research questions with defined variables, null hypotheses, and scope boundaries.
Draft an Institutional Review Board Ethical Risk Assessment
Generate a comprehensive ethical risk assessment for field research studies to ensure compliance with Institutional Review Board standards for participant safety and data privacy.
Build a Citation-Verified Policy Brief From Pasted Primary Sources
Turn pasted primary documents into a strict policy brief where every claim carries a verbatim-checked source tag, an evidence grade, and a log of unsupported gaps.
Audit Industry Benchmark Reports for Bias and Missing Data
This prompt analyzes industry reports to identify cherry-picked metrics, hidden survivorship bias, and missing control group data that undermine statistical validity.
- Synthesize Conflicting Systematic Reviews into an Executive Consensus Map
- Audit Statistical Reporting Integrity in Empirical Research Papers
- Fact-Check a Viral Claim With Primary Sources and a Confidence Rating
- Two-to-Three Model Comparison Test Plan with 10 Prompts and Scoring Rubric
- Weekly AI Tools Brief for a Team Lead with Dated Sources and One Experiment
- Vendor Shortlist Decision Memo with Weighted Scoring and Source Citations