Worked question 14 - Experimental Design
Evaluate the design of this investigation, referring to at least three different weaknesses and the effect each has on the validity of the conclusions.
Answer and mark scheme
Question 14
| Credit | Answer or working |
|---|---|
| B1 | no control group: all 12 runners receive the energy bar, so there is nothing to compare against to isolate its effect, oe |
| B1 | no blinding: knowing they have the 'new' bar could create a placebo effect (expecting to run faster), biasing times regardless of the bar's real effect |
| B1 | comparing to personal bests does not hold other variables constant, e.g. weather, course or the runner's current fitness could differ from the earlier race and confound the comparison, oe |
| B1 | the sample is small (12) and drawn entirely from one running club, so it may not be representative of marathon runners generally, limiting how far conclusions can be generalised |
| B1 | an overall judgement is given, e.g. the conclusion that the bar improves times is not well supported without a randomised, controlled, blind design comparing to a genuine control group under matched race conditions |
- Answer: The design is weak. There is no control group, so there is nothing to isolate the bar's effect from other causes. Runners are not blinded, so knowing they have the new bar could create a placebo effect. Comparing to personal bests does not control for other variables such as weather, course or current fitness. The sample is also small and drawn from a single club, limiting how far results can be generalised. Overall, the claim is not well supported without a randomised, controlled, blind trial comparing matched groups under the same conditions.











