AI Systematic Biases · prompt and context

Context-position sensitivity

A model can use the same relevant information differently depending on where that information appears in a long context.

Human analogy: primacy and recency effects. This is a behavioural analogy, not a claim that the model has the same mental mechanism.

Why it matters

Where this breaks real systems

RAG and long-document systems can miss evidence not because it was absent, but because retrieval placed it in a weak part of the context.

Evidence status: well documented historically; newer long-context models require fresh re-testing

Evidence level: peer reviewed multi study

Signals

What to look for

  • Answer quality drops when the relevant passage moves from the beginning or end into the middle.
  • Retrieval succeeds but generation still ignores a centrally placed passage.

Self-test

Test it in your own model or workflow.

Hold documents constant and rotate the relevant passage through early, middle and late positions. Measure answer accuracy and citation use.

Record the exact model identifier, surface, system prompt, relevant settings and run date. A single surprising answer is an anecdote, not a bias measurement.

Mitigation

Make the workflow harder to fool.

  • Test context placement as part of RAG evaluation.
  • Reduce irrelevant context instead of filling the entire window by default.
  • Use retrieval and reranking strategies that expose decisive evidence clearly.

Applies to

System contexts

rag and document assistants research and summarization coding and automation agents

Dated model evidence

Snapshots, not permanent labels.

These findings describe the model or model set tested at the stated time. A newer release needs new evidence.

Historical snapshot

long-context language models evaluated by Liu et al.

Evidence date
2024-01-01
Status
peer reviewed historical snapshot

Performance was often strongest when relevant information appeared near the beginning or end and weaker in the middle.

Open source →

Sources

Evidence behind this entry

  1. Lost in the Middle: How Language Models Use Long Contexts
    TACL 2024 · 2024 · DOI 10.1162/tacl_a_00638 · peer-reviewed
  2. Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization
    Findings of ACL 2024 · 2024 · DOI 10.18653/v1/2024.findings-acl.890 · peer-reviewed