Extension Neglect · Entry 46
Insensitivity to Sample Size – when small samples mislead you
Do you make conclusions based on just a few examples, assuming they reflect reality? That’s Insensitivity to Sample Size – the tendency to underestimate how much small samples can distort results.
Where it can show up
- Surveys – someone claims to know ‘public opinion’ based on just 10 random responses.
- Business – an entrepreneur tries an ad once, gets a bad response, and decides it doesn’t work.
- Medicine – you hear that two people recovered using an unusual treatment and assume it’s effective.
A practical countermeasure
- Check the sample size – the smaller the dataset, the higher the chance of randomness.
- Don’t trust anecdotal evidence – one success story doesn’t prove a trend.
- Look for statistical validation – if something truly works, it should work in large samples.
