16 FEBRUARY, 2026 / JON EDWARDS, M.ED
Why Knowledge Tests Can't Measure Professional Judgment
Judgment and knowledge are different skills. Most training programs test knowledge and assume judgment will follow. It does not.
What Knowledge Tests Are
Knowledge tests confirm exposure, familiarity, and recall. They are efficient and consistent. You ask a question. The person answers. You score it. You know what they were exposed to and whether they retained it.
"What is the first step in handling a client complaint?" "How do you organize a shared drive?" "What does CRM stand for?" These have right answers. A person either knows or does not.
Knowledge tests are useful. They confirm baseline competence. But they are limited. They confirm what someone remembers, not how they think.
What They Cannot Measure
Judgment appears only when information is incomplete and outcomes are uncertain. In knowledge tests, all the information is provided. The answer is right or wrong. In real work, information is incomplete. You have to decide based on what you do not know.
Example. A knowledge test asks: "What do you do if an email is urgent?" Right answer: "Flag it and respond within 2 hours." A person can ace this question and still fail in real work.
Real scenario: Your client sends an email marked urgent. But you do not know if your client marks everything urgent or if this one actually is. You do not know if they are actually available to receive a response. You do not know if responding immediately will interrupt something more important. You have to judge. That is not in the test.
Judgment involves tradeoffs, timing, and prioritization. These do not fit neatly into fixed-answer formats.
Risk tolerance. A knowledge test has a right answer. Real work has acceptable risk. A VA must judge how much risk is acceptable and act accordingly. One VA might escalate a problem immediately. Another might try to solve it. Both might be right depending on the situation.
Incomplete information. In testing, you provide all relevant facts. In work, you do not. A VA must ask questions, make assumptions, and act despite missing information. A test cannot capture this.
Values and priorities. A knowledge test expects uniform responses. Real work requires judgment about what matters. One client cares about speed. Another cares about precision. A VA must judge which applies.
The Illusion of Readiness
A person can score highly on a knowledge test and still struggle in real client situations, not due to intelligence, but due to inexperience with ambiguity.
They know the rules but have not practiced applying them in messy situations. They have not experienced the cost of a wrong judgment call. They have not built intuition about when to escalate, when to act independently, and when to ask for direction.
A high test score says "this person has good retention." It does not say "this person is ready for a real client."
Why Consistency Is Misleading
Tests reward uniformity. Real work produces variance. Judgment reveals itself in reasoning, not answer selection.
Two VAs might handle the same situation differently. Both could be right. A test would mark one wrong. Real evaluation would ask "What was your reasoning?" "Why did you make that choice?" "What would you do differently?" That reveals judgment.
A good assessment is not looking for uniform answers. It is looking for sound reasoning under uncertainty.
What Evaluation Must Do Instead
Meaningful evaluation requires scenarios, ambiguity, and explanation. It observes how someone thinks, not what they remember.
Scenario-based assessment. Present a realistic situation with incomplete information. Ask the person how they would handle it. Ask them to explain their reasoning. That reveals judgment.
"Your client has not responded to your email in 3 days. What do you do?" There is no single right answer. But there are thoughtful answers and careless answers. A thoughtful answer shows judgment. A careless answer shows the person acts without thinking.
Open-ended prompts. Ask the person to describe their process. "How do you decide whether an email is urgent?" Their answer reveals assumptions, priorities, and how they think through ambiguity.
Follow-up questions. Ask "Why?" When someone gives an answer, dig deeper. "Why would you do that?" "What could go wrong?" "What would you do differently if circumstances were different?" These reveal the depth of their thinking.
Observed performance. Have the person actually do the work while someone observes. You learn far more watching someone navigate a real scenario than reading their test answers.
For Organizations Building Training
If you are building training that is supposed to improve judgment, you cannot just teach knowledge. You have to create conditions where people practice judgment. Scenarios. Case studies. Simulations. And assessment that evaluates how they think, not just what they remember.
Testing knowledge is easier. But if you want to know whether someone has developed judgment, you have to evaluate differently.
Helping businesses scale with skilled Virtual Assistants, OBMs, and Support Specialists. Every assistant is trained before joining your team.
Ready to work with a certified VA?
Every Tanta Global Assist VA is TGA-certified before placement. No guessing. No training on your dime.
Get Your Free VA Gap Report