Screen survey data for duplicate and low-effort responses

Audit raw survey records for gibberish, straightlining, rapid completion times, and duplicate entries to clean your dataset.

You getAudit Summary, flagged Records Table and data Hygiene Checklist

Prompt

Prompt
Act as a survey data quality auditor. Screen the raw survey records below for spam, speeders, straightliners, and low-effort entries.

Rules:
- Identify records with completion times substantially below standard reading thresholds.
- Flag straightlining patterns (identical score selection across all grid questions).
- Identify duplicate responses based on identical text answers, IP/ID indicators, or matching answer signatures.
- Flag nonsensical, copy-pasted, or gibberish text in open-ended fields.
- Provide a clear recommendation (Keep, Review, or Remove) for each flagged record with explicit justification.

Output format:
- Audit Summary: Total records reviewed, total clean records, total recommended for removal.
- Flagged Records Table: Record ID, Flag Type, Reason, Recommendation.
- Data Hygiene Checklist: 3 checkable steps to improve respondent validation before the next wave.

My survey records are below:

Example output

Example for: 15 survey entries from an incentivized consumer brand study

Audit Summary
  • Total records reviewed: 15
  • Total clean records: 11
  • Total recommended for removal: 4
Flagged Records Table
Record IDFlag TypeReasonRecommendation
#104SpeedingCompleted 25 questions in 34 seconds (median time: 4.5 minutes).Remove
#109StraightliningSelected "5 - Strongly Agree" across 12 consecutive positive and reverse-coded statements.Remove
#112Gibberish TextOpen-ended feedback field contains "asdfghjkl qwerty".Remove
#115Near DuplicateIdentical text comment and exact demographic values as #103 submitted 4 minutes later.Review
Data Hygiene Checklist
  • [ ] Implement a minimum duration threshold filter that discards completes under one-third of the median test time.
  • [ ] Add at least one reverse-coded item into large Likert scale matrices to detect straightlining.
  • [ ] Enforce captcha or browser token validation on submission to deter repeated automated entries.
Written by AI from this prompt. Your results will vary.

Paste your tabular survey rows or CSV excerpt into ChatGPT, Claude, or Gemini. Follow up by asking the AI to produce filtered export instructions or clean data verification rules.

Make it repeatable

Keep using this prompt without pasting it in every time.

Keep exploring

More in Data Analysis
Data Analysis

Map and inspect an unfamiliar data export

Quickly understand the purpose, column types, and data quality risks of a messy raw CSV export. Ideal when inheriting unfamiliar operations sheets.