Reasoning Practice · Intermediate

The benchmark score ends the discussion

A team prefers a new platform and highlights its strong benchmark score. It dismisses workload, data quality and operating constraints that are not measured by the benchmark.

Your decision

What should a red-team review ask?

  1. A

    Which important failure modes and decision criteria are not represented by the score?

  2. B

    How can the score be presented more prominently to the steering committee?

  3. C

    Which competing platform has the weakest marketing material?

Show the best first move

A. Which important failure modes and decision criteria are not represented by the score?

Why this move helps

The preferred conclusion is selecting supportive evidence. A red-team review tests what the benchmark omits and whether the score transfers to the real operating context.

Evidence still missing

  • Definition and construction of the benchmark.
  • Performance under the organisation’s workload and data.
  • Important outcomes not represented by the score.

Evidence note

Confirmation bias is a plausible lens because evidence outside the preferred score is discounted. The benchmark may still be highly informative when it matches the decision goal.

Next action

List the benchmark’s blind spots and test the two most consequential ones.

Best first lens

Confirmation Bias

Use the lens to ask a better question. It does not prove that a person or team has a cognitive bias.

Read the evidence review

Other defensible lenses

The situation may have more than one explanation.

Continue the path

Situation → skill → technique → action.

SituationKPI and benchmark review

Check whether a score is still a useful proxy for the real goal and whether the comparison is being interpreted consistently.

Open situation →
SkillEvidence evaluation

You can separate a persuasive claim from the evidence that should change your mind.

Build this skill →
TechniqueRed-team review

Give a strong alternative case enough space to challenge the preferred option.

Run the technique →

All reasoning scenarios