Calibrate Hiring Panel Scores and Flag Inconsistent Interviewer Ratings
Paste your panel's scores and notes to get a score matrix, flagged spreads over one point, evidence separated from impressions, and a timed debrief agenda.
You getScore matrix table, disagreement breakdown and bias and protected-trait flags
Prompt
You are a hiring operations lead who runs calibrated panel debriefs.
I will paste each interviewer's scores and written notes for one candidate right after this message. Find where the interviewers disagree, check whether each rating is backed by evidence, and build a debrief agenda that resolves each disagreement.
Rules:
1. Flag any competency where interviewer scores differ by more than one point on the scale used. List flagged items first, largest spread at the top.
2. For every flagged rating, sort the interviewer's note into Evidence (something the candidate said or did) and Impression (feelings, "seemed", gut reactions, vague fit comments). Quote the notes. Do not invent content.
3. Name the likely cause of each spread: different evidence, different bar, topic not covered, or impression without evidence.
4. Give each agenda item one question the panel must answer, an owner and a time box. Keep the total agenda to 30 minutes or less.
5. Do not recommend hire or no-hire. Flag any note that mentions age, family, health, accent, religion or another protected trait.
Output format:
1. Score matrix table: Competency | one column per interviewer | Spread | Flag
2. Disagreement breakdown: for each flagged competency, Evidence and Impression bullets per interviewer, then Likely cause
3. Bias and protected-trait flags, or "None found"
4. Debrief agenda: numbered items with question, owner and minutes
End with one line on what is missing from the pasted material, such as unscored competencies or absent notes.Example output
Tips and common edits
Why this works
- The one-point spread threshold gives an objective trigger, so the debrief focuses only on real disagreements.
- Splitting notes into Evidence and Impression shows which scores rest on observed behavior and which rest on gut feel.
- Banning hire or no-hire advice and flagging protected traits keeps the AI in a support role and surfaces legal risk early.
Use it right before a panel debrief, once all interviewers have submitted feedback. Paste every scorecard and note in full into ChatGPT, Claude or Gemini, and include the rating scale.
Common edits
- Change the flag threshold to any spread of one point or more for executive roles.
- Ask for a short summary email to send to the panel before the meeting.
Make it repeatable
Keep using this prompt without pasting it in every time.
Prompt details
- By
- Prompts-GPT editors
- Published
Did this prompt work?
Keep exploring
More like this
Write a 20-Minute Phone Screen Script with Knockout Questions and Pass Criteria
Get a timed 20-minute phone screen script where every question has a written pass threshold, knockouts come first, and each one has a note on what not to ask for legal reasons.
Turn Interview Notes into a Fair, Evidence-Based Hiring Recommendation
Paste your interview notes and get a hiring recommendation that separates evidence from impressions, rates each role criterion, and lists doubts to check before an offer.
Evaluate intern presentations for full-time conversion
Generate a fair rubric and debrief agenda to score final intern presentations and make return offer decisions.
Internal promotion business case for review panels
Draft a persuasive, evidence-based business case to justify an employee promotion to talent committees and compensation panels.
Compare a Resume to a Job Description with Evidence Ratings and Probe Questions
Get a requirement-by-requirement table rating resume evidence as strong, partial or missing, plus one targeted interview probe question for every gap.
Draft a Learning and Development Budget Policy with Caps, Approvals and Clawback
Get a complete learning budget policy with dollar caps, tenure-based eligibility, a numbered approval workflow, a clawback table and flags for clauses that need legal review.
- Write Reference Check Questions and a 1-4 Scoring Sheet for a Finalist
- Build a Short Employee Pulse Survey on Engagement and Culture
- Turn Exit Interview Notes into Retention Themes and Owner-Assigned Actions
- Turn Rough Company Values into Clear Do and Don't Behaviors
- Write a Fair, Documented Written Warning Letter for Employee Misconduct
- Write a Respectful Layoff Announcement with Manager Talking Points