Free portable Agent Skill

Evidence Evaluation

Evaluate whether a claim deserves confidence before repetition, fluency, vivid examples or preference are mistaken for evidence. Use for research, proposals, fact checks and consequential AI-generated claims.

Agent SkillsHermes AgentOpenClawChatGPT SkillsCodex

Open SKILL.md Back to marketplace

What it does

A repeatable workflow, not another bias-name list.

Use it when

A team already prefers one explanation and is mainly gathering support for it.
A claim appears in many places but may trace back to one source.
A vivid example is dominating broader evidence or base rates.
An AI answer sounds convincing but important claims remain unverified.

It returns

Claim under review
Evidence that supports it
Evidence or tests that could weaken it
Source independence / provenance notes
Current confidence and limitations
Decision implication

Install

One SKILL.md. No API key.

Hermes Agent

mkdir -p ~/.hermes/skills/evidence-evaluation && curl -fsSL https://cognitive-biases.github.io/agent-skills/evidence-evaluation/SKILL.md -o ~/.hermes/skills/evidence-evaluation/SKILL.md

OpenClaw

mkdir -p ~/.openclaw/workspace/skills/evidence-evaluation && curl -fsSL https://cognitive-biases.github.io/agent-skills/evidence-evaluation/SKILL.md -o ~/.openclaw/workspace/skills/evidence-evaluation/SKILL.md

Other Agent Skills-compatible tools

Download SKILL.md and place it in the skill directory supported by your agent. ChatGPT Skills and Codex support the Agent Skills format; their installation surface can vary by product.

Safety boundary

Useful skepticism without amateur diagnosis.

Do not treat source count as independent confirmation when sources repeat one origin.
Do not use another generated answer as independent verification of an AI-generated claim.
Do not upgrade confidence because wording is fluent, familiar or repeated.
Keep unknowns visible rather than filling them with plausible prose.

Instruction-only · no secrets · no executable code · no required network access · CC BY-NC-SA 4.0

Evidence-linked lenses

The skill checks patterns. It does not diagnose people.

Confirmation Bias

Confirmation bias is an umbrella label for several ways existing beliefs or hypotheses can influence information search and interpretation. It should not be reduced to one behaviour such as reading only agreeable news, and a preference for confirming tests is not irrational in every task or environment.

Illusory Truth Effect

Repeated claims receive higher truth ratings than comparable new claims on average, but the effect is heterogeneous and does not generalize equally to every kind of statement. A 2026 systematic review and meta-analysis covering 182 studies, 366 effect sizes and more than 31,000 participants found a reliable corrected average effect. A later 2026 paper with two preregistered experiments found little or no meaningful repetition effect for social-political opinion statements. The useful claim is therefore narrower than 'repeat anything and people will believe it.'

Availability Heuristic

Availability is a judgment heuristic: people can use how easily examples or scenarios come to mind when estimating frequency or probability. That shortcut is not automatically an error because memorable or accessible examples can correlate with real frequency. Bias appears when accessibility is driven by factors that are not diagnostic of the quantity being judged.

Continued Influence Effect

The continued influence effect describes a specific pattern: false or outdated information can keep affecting later reasoning even after a clear correction. It does not mean the correction had no effect, that the person rejected the correction, or that belief in the false claim became stronger. Corrections often reduce misinformation reliance without removing it completely. That distinction matters because continued influence is much broader than the rarer backfire outcome.