What is interviewer calibration?
Interviewer calibration means comparing how different interviewers score candidates, finding those who are consistently harsher or more generous than the rest, and adjusting so a score means the same thing whoever gave it.
Harsh vs lenient interviewers
Look at each interviewer’s score distribution over the last few months. If one person’s average is a full point below everyone else’s on the same scale, candidates who meet them start at a disadvantage. That is a form of interviewer bias even when every individual score feels fair.
How to calibrate interviewers
- Use the same scorecard and written rubric for every interviewer.
- Have new interviewers shadow, then score alongside an experienced one.
- Compare score distributions every quarter and share the results.
- Review a few past candidates together and discuss where the scores differed.
Running an interview calibration meeting
Before a hiring decision, each interviewer shares their scores and the evidence behind them without first hearing anyone else’s view. Disagreements are settled by looking at the evidence against the rubric, not by seniority. Done regularly, this improves interview score consistency more than any amount of training.
Last reviewed 2026-11-01.