Revision Library
Choose a subject
Menu
GCSE Statistics · Topic guide

Pilot Surveys (Foundation)

A pilot survey is a small-scale trial run of a questionnaire or survey, carried out before the main data collection, used to check that the questions are clear, unambiguous and produce useful answers. It lets researchers spot and fix problems, such as confusing wording or missing response options, before spending time and money on the full survey.

FoundationCollecting DataEdexcelAQACCEA

Before you start

Make sure you're comfortable with these topics first:

Method

  1. Write a draft version of the full questionnaire or survey.
  2. Select a small sample of people, similar to those in the target population, to complete the draft survey.
  3. Check whether respondents understood each question the same way, and whether any questions were left blank, confusing, or led to biased answers.
  4. Check that closed questions have enough response options to cover everyone's likely answer, with no gaps and no overlaps.
  5. Amend or remove any questions that caused problems, based on the feedback from the pilot.
  6. Carry out the main, larger-scale survey using the improved, piloted questionnaire.

Common mistakes

  • MistakeTrying out the questionnaire on a few people who are nothing like the people who will take the main survey, then treating 'no problems' as proof that it works.

    InsteadPilot it on a small group similar to the target population, such as pupils of the same age for a school survey. Some problems, such as wording pitched too high for the age group, only show up with people like the real respondents.

  • MistakeAdding the pilot answers to the main results even though a question was reworded or its options changed afterwards.

    InsteadThe pilot group answered a different version of the question, so their answers do not belong with the main results. Use the pilot to improve the questionnaire, then collect the main data afresh.

  • MistakeRunning a pilot but changing nothing, or only correcting spelling, when several people ticked two boxes, skipped questions or wrote in their own answers.

    InsteadTreat each blank, double tick or written-in comment as evidence. Decide what it says about the question or its options, then reword the question or change the options to fix it.

Worked examples

Example 1

A student is designing a questionnaire to find out how much time people spend exercising each week, before giving it to all 200 people in her survey. Explain why she should carry out a pilot survey first, and describe one thing she might check.

  1. State the purpose: a pilot survey tests the questionnaire on a small group before it is used on all 200 people.
  2. Give a reason it is useful: it avoids collecting 200 sets of unclear or biased data if a question turns out to be confusing, saving time and effort.
  3. Give an example of something to check: whether the tick-box time bands, such as '0-2 hours' and '2-4 hours', overlap or have gaps, since someone who exercises for exactly 2 hours would not know which box to tick.
  4. So the final answer is: yes, she should pilot the survey first, for example to check that the response bands for the exercise-hours question do not overlap.

Example 2

A school council pilots a survey on 12 students. One question reads: 'Are the school lunches healthy and good value for money?' with the options Yes, No and Not sure. Three of the 12 students explained that they could not answer, because they think the lunches are healthy but poor value. Explain what the pilot shows about this question and rewrite it for the main survey.

  1. Treat the explanation as evidence: 3 of the 12 students, 25% of the pilot group, could not choose an honest answer.
  2. The fault is that the question asks two things at once (healthy, and good value). A single Yes, No or Not sure cannot show which part a student means, so the answers to the main survey would be hard to interpret.
  3. Fix it by splitting the question in two, each with its own options.
  4. Question 1: 'Are the school lunches healthy?' Yes / No / Not sure. Question 2: 'Are the school lunches good value for money?' Yes / No / Not sure.
  5. Check the new questions: each asks about one idea, and every student can find an answer that fits.
  6. Final answer: the pilot shows that the question is really two questions in one, so the council should replace it with one question about health and one about value before running the main survey.

Practice questions

Q1[1 mark]What is a pilot survey?Show answer

Answer: A small-scale trial of a survey or questionnaire, run before the main survey, to test and improve it.

Got it right?
Your answerWork it out on paper, then show the answer and mark yourself.
Q2[1 mark]Give one reason a researcher would carry out a pilot survey.Show answer

Answer: To check the questions are clear and not confusing or ambiguous before the main survey (or: to save time and cost by fixing problems early).

Got it right?
Your answerWork it out on paper, then show the answer and mark yourself.
Q3[1 mark]A pilot survey shows that many respondents left a question blank. What might this suggest about the question?Show answer

Answer: It may be unclear, too personal or sensitive, or missing a suitable response option, so people did not know how to answer.

Got it right?
Your answerWork it out on paper, then show the answer and mark yourself.
Q4[1 mark]A tick-box question has the options '0-10', '10-20', '20-30'. What problem would a pilot survey likely identify with this?Show answer

Answer: The bands overlap (10 could go in two boxes), so someone answering exactly 10 would not know which box to tick.

Got it right?
Your answerWork it out on paper, then show the answer and mark yourself.
Q5[1 mark]State one change a researcher might make to a questionnaire as a result of a pilot survey.Show answer

Answer: Reword an unclear question, add missing response options, or remove a question everyone answered the same way (any sensible improvement).

Got it right?
Your answerWork it out on paper, then show the answer and mark yourself.
Q6[2 marks]A company pilots its customer feedback survey on 20 customers before sending it to all 5000 customers. Explain why using only 20 people is still useful.Show answer

Answer: It is a quick, low-cost way to catch major problems, such as confusing wording or missing options, before committing time and money to surveying all 5000 customers.

Got it right?
Your answerWork it out on paper, then show the answer and mark yourself.

Exam-style questions

Written in the style of a GCSE Statistics exam paper, with a full mark scheme.

Exam tips

  • When asked for a problem with a question, name the fault exactly: a leading word, two questions in one, or options that overlap or leave a gap. 'It is confusing' does not say what to change.
  • When asked to improve a question, write the new question out in full with its response options, rather than describing the change in words.
Q1[2 marks]State what is meant by a pilot survey, and give one reason for carrying one out.Show mark scheme

Tick each line you got.

Nothing ticked yet - 2 available

Got it right?
Q2[3 marks]A researcher pilots a survey question, 'Do you exercise a lot?', with 15 people before the main survey of 300 people. (a) Identify a problem with this question. (b) Suggest an improved version of the question.Show mark scheme

Tick each line you got.

Nothing ticked yet - 3 available

Got it right?
Q3[4 marks]A council plans to survey all 4000 residents of a town about a new recycling scheme. Before doing so, they run a pilot survey on 25 residents. (a) State two things the council should check for during the pilot survey. (b) Explain one benefit of running the pilot survey before contacting all 4000 residents.Show mark scheme

Tick each line you got.

Nothing ticked yet - 4 available

Got it right?

See real GCSE Statistics past-paper questions, with official mark schemes 

Free printable worksheet

Want more practice on paper? Download the Pilot Surveys (Foundation) worksheet pack - 25 pages of exam-style questions with a full mark scheme. Free to download, no card or account. Print it for personal and classroom use.

This topic is chapter 4 of GCSE Statistics Foundation Essentials 1, the whole course as one free printable PDF. Its worksheet is also chapter 4 of GCSE Statistics Foundation Topic Workbook 1 and chapter 4 of GCSE Statistics Foundation 10-Minute Tests 1, free printable practice books.

Other versions of this worksheet:

Keep going

Not quite what you needed?

Tell us what is missing on Pilot Surveys (Foundation), or which topic to write up next.

Build a full practice pack.