Is this sample fair? worksheets

A statistic is a claim about a whole group made from a handful of it, and it is only worth anything if that handful could have been anybody. These free printable worksheets give fifteen ways of choosing a sample and ask which ones are fair.

Is this sample fair?
Is this sample fair? worksheet — Fifteen sampling methods, three verdicts, free printable with answer key

The answer key prints on a separate page.

What's on this sheet

The question is not who WAS asked — it is who could never have been. Asking students in the car park how they get to school can never reach the ones who walked; phoning a town on landlines cannot reach a household without one. That is coverage bias, and it is visible the moment you ask who is missing.

Why this sheet works

The harder half is voluntary response, because the sample looks open. A magazine prints a survey and everybody could reply; the people who do are the ones who felt strongly enough to find a stamp. A form emailed to all 400 staff that 40 choose to answer is not a random 40 — they picked themselves. The page names both failures separately rather than lumping them into “biased”, because a student who can only say “biased” cannot say how to fix the survey.

How this one works

Ask who could never have been asked

who is missing?
nobody missing
Yes — it is random
  1. A computer picks 200 customer numbers at random from the full list. A sample is only worth anything if it could have been anybody, so the question is not who WAS asked — it is who could not be.
  2. Nobody. Everyone in the group was in the draw and nothing about a person changed their chance of being picked. So the sample can stand for the whole group.
  3. The whole list goes in and the choosing is random: a fair sample.