Sampling · Foundations

Sampling Methods

A good sample is not just about how many observations you collect. It is also about how you choose them.

Introductory statistics≈ 8 min readNo formulas required
Start with this question

You want to estimate how satisfied all customers are with a company. Which 200 customers should you ask?

The answer determines whether your sample can represent the population.

The big picture

Probability sampling gives every unit a known chance of selection.

In probability sampling, selection is controlled by a random mechanism. That makes it possible to use a sample to learn about a larger population with a defensible statistical basis.

Probability sampling

Designed to represent

Simple random, systematic, stratified, and cluster sampling.

Preferred for statistical inference
Non-probability sampling

Designed for access or speed

Convenience and voluntary response samples are easier to collect but can be systematically biased.

Useful, but interpret carefully
Key idea: A large sample can still be a bad sample. Increasing sample size does not automatically fix a biased selection process.
01

Probability sampling

Simple Random Sample

Every possible sample of size n has the same chance of being selected. In practice, you need a list of the population and a random way to choose observations.

Randomly selected observations are highlighted.

Business example

A retailer has 12,000 loyalty-program members and randomly selects 300 customer IDs to estimate average satisfaction.

Best when: You have a complete population list and want a straightforward, unbiased design.

Watch for: It can be inefficient when important subgroups are small.

02

Probability sampling

Systematic Sample

Choose a random starting point, then select every kth observation. If you need 100 observations from a list of 1,000, you might select every 10th customer after a random start.

123456789101112131415
Business example

A quality analyst chooses a random starting item and inspects every 50th package leaving a production line.

Best when: Observations arrive in a natural sequence and you need a simple operational rule.

Watch for: Hidden patterns in the list can create bias if they line up with the sampling interval.

03

Probability sampling

Stratified Sample

Divide the population into meaningful subgroups called strata, then take a random sample from each stratum. The goal is to make sure important groups are represented.

Retail
Corporate
Government
Business example

A bank wants customer feedback and samples separately from checking, mortgage, and business-account customers so each segment is represented.

Best when: Subgroups differ in meaningful ways and each group should appear in the sample.

Watch for: You need good information about which stratum each population member belongs to.

04

Probability sampling

Cluster Sample

Divide the population into natural groups called clusters, randomly select some clusters, and then observe all—or a sample of—the units within those selected clusters.

Store A
Store B
Store C
Store D
Business example

A national retailer randomly selects 12 stores and surveys customers at those locations instead of building a list of every customer nationwide.

Best when: The population is geographically dispersed and collecting observations individually would be expensive.

Watch for: People inside the same cluster may be similar, which can reduce statistical precision.

Use with caution

Convenience and voluntary response samples

These methods are common because they are easy. The tradeoff is that the selection process can favor certain types of people, so the sample may not represent the population.

!

Convenience sample

Select the observations that are easiest to reach.

Example: Asking the first 50 customers who enter a store on Monday morning.

Main risk: Easy-to-reach people may systematically differ from everyone else.

!

Voluntary response sample

People decide for themselves whether to participate.

Example: Posting an open online poll asking customers to rate a recent policy change.

Main risk: People with strong opinions are often more likely to respond.

Compare

Which sampling method fits the situation?

MethodCore ideaGood choice when…Main concern
Simple randomRandomly select individualsYou have a complete population listSmall groups may be missed
SystematicSelect every kth unitUnits arrive in a sequence or ordered listPeriodic patterns
StratifiedSample within every subgroupImportant subgroups must be representedRequires subgroup information
ClusterRandomly select groupsPopulation is dispersed or costly to reachClusters may be internally similar
ConvenienceUse easiest observationsSpeed matters more than representativenessSelection bias
Voluntary responseParticipants opt inYou want open feedback, not a representative estimateStrong-opinion bias

A useful shortcut

1

Need every subgroup represented?
Consider stratified sampling.

2

Population spread across locations?
Cluster sampling may reduce cost.

3

Have a complete list?
Simple random or systematic sampling may work well.

One sentence to remember
The sampling method determines who gets a chance to be observed—and that determines how confidently the sample can represent the population.
Back to learning topics