WHY HIGH QA SCORES DON'T EQUAL HIGH CSAT
Is Your QA Scorecard Making Your CSAT Worse?
The QA/CSAT Paradox Diagnostic Workbook
The QA/CSAT Paradox occurs when your internal quality framework and your customer satisfaction scores are measuring fundamentally different things. Agents learn to optimise for the scorecard, because that is what drives performance ratings, coaching conversations, and career progression. When the scorecard rewards process compliance rather than resolution quality, agents produce exactly what it measures. And customers stay dissatisfied.
This workbook diagnoses whether your QA framework and your CSAT score are aligned , or whether your best agents are being penalised for doing the work that customers actually value.
The Loop This QA/CSAT Paradox Is Creating
When doing it right and doing it well are two different things, the QA framework has a design problem. The agent followed every rule. The customer left dissatisfied. Both things are true. And the QA framework made them both possible.
The most visible signal of this paradox is the agent-level divergence: your highest QA scorers are not consistently your highest CSAT scorers. When your best agents by customer satisfaction are mid-table on the internal quality metric, your scorecard is not measuring performance. It is measuring conformity. Those are different things and the departure signal confirms it: high-quality agents who leave and cite 'not being trusted to do the job properly' are telling you your QA framework has become a retention risk.
What's Inside the Workbook
Section 1: What Your QA Scorecard Actually Measures.
Lists your top five QA criteria by weighting or coaching focus and categorises each as primarily serving Compliance/Risk, Process/Script, or Customer Outcome. Asks what proportion of your overall framework is designed to protect the business versus designed to improve the customer experience. Reflection: how confident are you that a high QA score means the customer had a good experience?
Section 2: The Compliance Trap.
A seven-item rated scale examining the compliance trap in your centre, including whether agents follow the required opening script even when the customer is already frustrated, whether agents who deviate from script to resolve an issue faster are marked down, and whether coaching conversations focus on scorecard compliance rather than resolution quality.
Section 3: The Deviation Problem.
Examines whether you have agents who consistently score lower on QA but higher on CSAT, the clearest signal of a misaligned scorecard. Asks what happens when an agent deviates from the prescribed process to resolve a customer issue more effectively. The Best Agent Signal and The Departure Signal are both diagnosed here.
Section 4: The Scorecard Gap.
Maps the distance between what your QA scorecard rewards and what your customers say they value — using CSAT verbatim complaints, cross-reference analysis, and a direct question: when you look at what customers say they value most, does your scorecard give significant weighting to those things?
What You'll Be Able to Do After Completing This Workbook
-
Categorise your QA criteria by what they primarily serve, compliance, process, or customer outcome and calculate the proportion aimed at each
-
Identify whether the compliance trap is active in your centre and which specific behaviours it is producing
-
Find the agent-level divergence between QA and CSAT scores that signals a misaligned scorecard
-
Map the gap between what your scorecard rewards and what customers say they value and know which track applies: monitor, reweight, or redesign
Who This Workbook Is For
This workbook is for contact centre leaders who suspect their internal quality framework is producing well-scored but poorly resolved calls and that their best agents are aware of the gap. It is particularly relevant if:
-
Your highest QA scorers are not consistently your highest CSAT scorers
-
Agents have told you, directly or indirectly that the QA framework prevents them from doing their best work
-
Calls that score highly on QA regularly appear in negative CSAT verbatim feedback
Frequently Asked Questions
01
Do I need detailed QA data to complete this workbook?
You need your current QA criteria and a general sense of whether your QA and CSAT scores diverge at the agent level. The workbook also includes a four-step data audit, pulling 30 QA-scored calls, mapping agent-level divergence, analysing CSAT verbatim complaints, and interviewing three agents that you can run in the seven days following the diagnostic to build a more precise evidence base.
02
What is the compliance trap?
The compliance trap occurs when agents are rewarded for following the process regardless of whether it serves the customer. Over time, following the process becomes the goal, not because agents don't care about customers, but because the scorecard signals that process adherence is what the organisation values. Resolution becomes optional. That is not an agent problem.
03
What are the three action tracks?
Track A (Redesign the Scorecard) for scores of 33–50 or consistent agent-level QA/CSAT divergence.
Track B (Reweight the Criteria) for scores of 16–32 where specific compliance criteria have been identified as problematic.
Track C (Monitor and Validate) for scores of 0–15 where the framework appears broadly aligned. Each track has four specific actions to take in the next 30–90 days.
04
What is the Best Agent Signal?
If your highest-performing agents by CSAT are mid-table on your QA ranking, your scorecard is not measuring performance. It is measuring conformity. That divergence is the clearest signal that the framework and the customer experience are misaligned.
A score of 33–50 indicates that your QA framework is actively working against your CSAT score. Agents are doing exactly what your system asks and customers are staying dissatisfied. The recommended next step is the full Sentiment Gap Intervention at /reduce-complaints-contact-centre, which includes a scorecard redesign methodology, QA/CSAT alignment framework, and a 90-day closure roadmap.
What does a High Paradox Risk score mean?
05
READY TO BREAK THE LOOP?
The diagnostic found the problem. The intervention fixes it.
Your score tells you where the system is failing. The full BTL Co. intervention gives you the structured methodology to redesign it with phase-by-phase guidance, facilitation tools, and a measurement framework that proves the change is working.
This is where the evidence you've built becomes a case for action.