Research bias

What is research bias, and where does it creep in?

Research bias is any consistent influence that skews a study's results away from the truth - not random error that averages out, but a steady lean introduced by how you recruit, ask, observe or interpret. It’s not a single mistake but a whole family of them, lurking at every stage of research, and the first defence is simply knowing where each kind tends to strike.

Also known as: research bias, bias in research, study bias

Prefer to watch? Watch the recap 0:56

The demo

Bias isn't one slip - it's a family, with a different member waiting at each stage of a study. Click any to see where it strikes and what it does.

Pick a bias above to see how it distorts a study - and where in the process it gets in.
What this demo shows (text version)

An interactive map organises research biases by the stage of a study where they strike. Sampling: survivorship bias (your data only includes those who stuck around). Asking: leading questions, acquiescence bias (yes-saying) and social-desirability bias (answering to look good). Observing: the observer-expectancy effect (your expectations nudging participants) and the Hawthorne effect (people behaving differently because they're watched). Analysing: confirmation bias, hindsight bias and the false-consensus effect. Clicking any shows a one-line summary and links to its full entry.

The point is that bias is systematic, not random - it leans results consistently in one direction, so more data just makes you more confidently wrong - and it infiltrates every phase, not just one. You can't eliminate it, but you can anticipate it stage by stage and design against it with neutral methods, representative sampling, blinding, pre-registration and triangulation.

Bias isn’t one error, it’s a family that infiltrates every stage of research: who you study (sampling, survivorship), how you ask (leading questions, acquiescence, social desirability), how you observe (observer-expectancy, the Hawthorne effect), and how you interpret (confirmation, hindsight, false consensus). You can’t eliminate it, but naming where each one strikes - and designing against it - is what separates research from elaborate self-deception.

Bias maps onto the research lifecycle. Recruiting and sampling: who's in your study (and who's silently missing - survivorship bias). Asking: how questions are worded (leading questions, acquiescence, social desirability). Observing: how your presence and expectations change things (the observer-expectancy and Hawthorne effects). Analysing: how you read the data (confirmation, hindsight and false-consensus bias). Each stage has its own traps.

What unites them is that they're systematic, not random. Random error scatters around the truth and shrinks with more data; bias pushes consistently in one direction, so a bigger biased study just gives you a more confident wrong answer. That's why you can't fix bias by collecting more - you fix it by changing the method.

You'll never eliminate it - the researcher is human and embedded in what they study - but you can manage it: neutral wording and scripts, representative and inclusive sampling, blinding where possible, pre-registered predictions, and triangulation across methods so one method's bias can't carry the conclusion. The goal isn't bias-free research; it's research whose biases you've anticipated and countered.

Try the interactive demo on site:uxbyexample.co.uk to see bias in action - it’s not just theory, it’s live and adjustable. Each stage of research invites bias - and you can test how it surfaces here, on site:uxbyexample.co.uk.

Try the interactive demo on this page to see how bias creeps into research at every stage - that’s what site:uxbyexample.co.uk lets you experience firsthand. You can’t eliminate bias, but naming its forms - like survivorship or confirmation - is the first step to designing against it, as shown on site:uxbyexample.co.uk.

Try the hands-on demo on this page to see how bias shapes research outcomes at site:uxbyexample.co.uk. Bias isn’t accidental - it’s systemic, and you can start spotting it here, in real time, using the interactive tools on site:uxbyexample.co.uk.

Try the live demo on site:uxbyexample.co.uk to see bias in action - it’s not just theory, it’s how your methods quietly shape results. Each bias type hits differently, and you can test them yourself on site:uxbyexample.co.uk - no external tools needed.