12 March 2025 | Callum van Dyk, Psychologist

Effective Interview Scoring Conversations – Was I wrong to do this? 

So, you've just wrapped up an interview. You and your colleague followed a structured process, meticulously managed the schedule, made the candidates feel comfortable, asked them insightful questions, and gathered strong behavioural evidence. You probed deeper into areas of uncertainty and systematically scored the candidate against predefined criteria. Brilliant, but it's not over yet. The next step is crucial: discussing your assessment with your colleague. This scoring conversation ensures that both perspectives are shared and that the final evaluation is a fair observation of everyone who is in the room.
Description

Imagine this situation: You walk into the scoring conversation feeling confident. In your mind, the candidate performed well, demonstrating strong competency across multiple areas. You’re prepared to advocate for them. But then, before you even have a chance to speak, your colleague leans back, shakes their head, and exclaims, “That was shocking, wasn’t it?” A wave of doubt crashes over you.

Wait, shocking? You briefly replay the interview in your head. Did you miss something, or did they pick up on a major red flag that completely escaped you? You become uncertain.

Should I revise my score? Your colleague has years more experience than you; surely they must have seen something you didn’t. The pressure to align with their judgment weighs even more heavily.

What will they think of me as an interviewer? If you stick to your initial assessment, will you come across as naïve, inattentive, or lacking sound judgment? If you adjust your score, will you be acting on instinct rather than evidence?

Adjusting my score slightly won’t cause any harm, will it? You alter your score slightly to align more closely with your colleague; I am sure everyone does this, and I’m sure being a harsher marker will only benefit us.

Open Conversation is Key 

It’s easy to assume that the person with the most experience in the role has the sharpest eye for talent. While this can be true, their judgment, just like anyone else’s, needs to be backed by evidence. The only way to ensure fairness is to communicate openly, share observations, and provide justification for your scores.

The scoring conversation should facilitate a structured discussion that leads to a well-rounded assessment rather than one swayed by personal perceptions or quick judgments.

Five ways to have better scoring discussions 

A successful scoring conversation doesn’t just happen; it requires intentionality. Here are key steps to ensure a meaningful discussion:

1. Set Aside Enough Time:

Rushing through this process can lead to quick, surface-level summaries that miss critical details. Allocate dedicated time to dissect candidate performance thoroughly. 

2. Share Evidence-Based Observations:

Instead of relying on vague impressions, focus on specific behaviours and responses. Statements like, “They handled the problem-solving question well by outlining clear steps and demonstrating critical thinking,” are far more valuable than subjective summaries.

3. Encourage Healthy Debate:

Disagreement is not just acceptable—it’s beneficial. Differing viewpoints spark discussions that lead to deeper insights. The key is to remain open-minded while ensuring that all assessments are rooted in factual evidence. 

4. Beware of oversalt perspective judgements:

Avoid generalising statements like “that was terrible” or “they were amazing,” as they can unduly influence perceptions. Stick to measurable, concrete examples when discussing performance.

5. Aim for Consensus but Accept Nuances:

Not every candidate will have a unanimous evaluation, and that’s okay. The goal isn’t necessarily full agreement but a well-rounded, fair, and justified decision.

What next?

If you remember three things from this discussion, let them be these: 

  • Always have the scoring conversation and challenge perspectives objectively. 
  • It’s okay to doubt your own scoring – but state your evidence clearly and confidently. 
  • Ensure sufficient time for thorough discussions – quick summaries won’t do justice to candidate assessments. 

By following these principles, your hiring decisions will be more structured, fair, and free from unnecessary bias. Ultimately, a well-executed scoring conversation ensures that the best candidates rise to the top – for the right reasons.

Our Inclusive Recruitment Programme helps you sharpen your assessment skills, provide evidence-based feedback, and compare ratings against expert benchmarks. This allows you to spot patterns in decision-making across your organisation and refine your hiring process for better, data-driven outcomes. 

Want to see it in action? Book a demo now!

FIND THE BEST TALENT. EVERY TIME.

This programme is open for trials for you to explore in your own time. Select which one you’d prefer.

Our Inclusive Recruitment programme empowers you to identify and select top talent for your job roles. Research-based and digitally led, the programme incorporates our unique learning tools that give participants constructive feedback on their strengths and areas for development as a recruiter.

Take your leaders and managers on a journey:

• Attract talented individuals from different backgrounds.

• Make fair and objective selection decisions.

• Find the best person for the job.

Try for free!