The Problem with Impressions
Most post-interview debrief conversations go like this: "I liked her - she seemed sharp and she would fit the culture." This is not an evaluation. It is an impression. And impressions correlate poorly with actual job performance.
An interview scorecard forces evaluators to commit to specific evidence before the group discussion begins. It is one of the most impactful changes a hiring team can make with minimal effort.
What a Scorecard Includes
1. Competencies (4 to 6 per role)
These are the specific capabilities that predict success. Not generic ones like "intelligence" or "culture fit" - those are too vague to score consistently. Good competencies for a sales role might be: discovery questioning, handling objections, closing methodology, and CRM discipline.
2. Behavioral indicators
For each competency, list what strong and weak performance looks like. This is what anchors your rating scale. Without this, two interviewers using the same 1-to-5 scale will have entirely different standards.
3. Interview questions mapped to competencies
Each question should be designed to surface evidence of a specific competency. Track which questions each interviewer will use, so different people cover different ground rather than all asking the same three questions.
4. Evidence section
After the interview, each evaluator writes specific quotes or examples they heard, before assigning a score. The discipline of writing evidence forces recall and reduces score drift.
5. Recommendation with rationale
Hire / No Hire / Needs Discussion, with a written reason. This prevents evaluators from simply averaging their scores - they have to take a position.
Common Scorecard Mistakes
- Too many competencies. If you score 12 things, nothing is prioritized. Pick 4 to 6.
- Undefined anchors. A "3 out of 5" means nothing without behavioral examples. Write at least three anchor points.
- Scoring after the debrief. Scores filled out after group discussion are contaminated by group influence. Score independently, then discuss.
- Ignoring disagreement. When two evaluators score the same competency as a 2 and a 5, that disagreement is signal. Explore it.
Building Your First Scorecard
Start with a role you hire at least 3 to 4 times per year. Take 90 minutes with the hiring manager to:
1. List the 5 most important things someone needs to do well in this role
2. For each one, describe what exceptional performance looks like in observable, behavioral terms
3. Write 1 to 2 questions that would generate evidence of each competency
4. Define score anchors at 1, 3, and 5
Run it for your next 3 hires. Refine it. Over time you will have a library of validated scorecards that turn hiring from a gut-feel activity into a repeatable, auditable process.