Skip to the worksheet
Revision Library
Choose a subject

Research methods: variables, hypotheses, choosing a statistical test and the sign test - Worksheets, Questions and Revision

9 original exam-style questions - 7 pages of questions with a full mark scheme - free printable PDF.

This topic is chapter 2 of A Level Psychology Topic Workbook 4 and chapter 21 of A Level Psychology 10-Minute Tests 2.

Revision Library
revisionlibrary.co.uk
A-Level · AQA

7.15 Research methods: variables, hypotheses, choosing a statistical test and the sign test

AQA 7182 · Calculator allowed · about 65 minutes
Total Marks
Name: _______________________________    Date: ____ / ____ / ______
Answer ALL questions.
1
A researcher wants to investigate whether the amount of sleep a person has affects their performance on a short-term memory test. Participants are randomly allocated to either a Low Sleep group (less than 5 hours the previous night) or a Normal Sleep group (7 to 9 hours the previous night), then complete a memory test in which they try to recall as many words as possible from a 15-word list, after a short distractor task. The number of words correctly recalled is recorded for each participant.
(a)Identify the independent variable (IV) and the dependent variable (DV) in this study.(2)
(b)State the experimental design used in this study.(1)
(Total for Question 1 is 3 marks)
2
The mindfulness study involves collecting personal information about participants' anxiety levels.
(a)Identify two ethical issues the researcher must address in this study, and explain how each could be dealt with.(4)
(b)Explain why debriefing is particularly important in a study measuring anxiety.(2)
(Total for Question 2 is 6 marks)
3
A hypothesis must be fully operationalised, and a study also needs a null hypothesis.
(a)Write a fully operationalised, directional (one-tailed) hypothesis for the study in Question 1.(3)
(b)Write the null hypothesis for this study.(2)
(Total for Question 3 is 5 marks)
4
Extraneous variables must be controlled, and the choice of experimental design has both strengths and limitations.
(a)Identify one extraneous variable that could affect the sleep and memory study, and explain how it could be controlled.(3)
(b)Explain one strength and one limitation of using an independent groups design, rather than a repeated measures design, for this study.(3)
(Total for Question 4 is 6 marks)
5
The table below can be used to help choose an appropriate inferential statistical test, based on the experimental design and the level of measurement of the data.
DesignNominal dataOrdinal/interval data (not normally distributed)Interval/ratio data (normally distributed)
Independent groupsChi-Squared test of associationMann-Whitney U testUnrelated (independent) t-test
Repeated measures / matched pairsSign testWilcoxon signed-rank testRelated (paired) t-test
Correlation between two co-variablesnot applicableSpearman's rank correlation coefficientPearson's product-moment correlation coefficient

Use the table above to answer the three scenarios below.
(a)A researcher tests whether more participants correctly recall a word (yes or no) after drinking caffeine than after a placebo drink, using two separate, independent groups of participants. State which statistical test should be used, and justify your choice, referring to the design and the level of measurement.(3)
(b)A researcher correlates 15 participants' total scores on an anxiety questionnaire (ordinal data) with their exam grade (also treated as ordinal data). State which test should be used, and justify your choice.(3)
(c)A researcher compares the same 10 participants' reaction times before and after sleep deprivation. The reaction-time data is interval-level but is not normally distributed. State which test should be used, and justify your choice.(3)
(Total for Question 5 is 9 marks)
6
A psychologist tested whether a brief mindfulness intervention reduces self-reported anxiety. Twelve participants completed an anxiety questionnaire (scored 0 to 20, where a higher score means greater anxiety) before and after a two-week mindfulness intervention (a repeated measures design).
ParticipantAnxiety score beforeAnxiety score after
11510
21213
31811
499
5148
6169
71115
8137
91712
10106
111511
12125
(a)State a suitable directional hypothesis for this study.(2)
(b)For each participant, state whether their anxiety score showed an increase (+), a decrease (-), or no change (0) after the intervention. Identify which participant(s), if any, should be excluded from the sign test, and state the value of n used in the test.(3)
(Total for Question 6 is 5 marks)
7
Using your working from Question 6, and the table of critical values for the sign test below, answer the following.
n (after excluding any tied/zero differences)Critical value of S (p < 0.05, one-tailed)
50
60
70
81
91
101
112
122
133
143
153

For the sign test, the result is significant only if the calculated value of S is less than or equal to the critical value shown for that value of n.
(a)State the value of S (the sign test statistic) for the data in Question 6.(2)
(b)State the critical value of S for this value of n at p < 0.05 (one-tailed), and state whether the result is significant. Explain your decision.(3)
(Total for Question 7 is 5 marks)
8
Using the data from Question 6 (n = 11 participants included in the sign test).
(a)Calculate the percentage of the 11 participants included in the sign test who showed a decrease in anxiety score. Give your answer to 1 decimal place.(3)
(b)Explain why the sign test result being 'significant' is not the same thing as saying anxiety scores decreased for every participant.(3)
(Total for Question 8 is 6 marks)
9
The anxiety questionnaire used in the study in Question 6 is an example of a self-report method.
(a)Explain one strength and one limitation of using a questionnaire, rather than a structured interview, to measure anxiety in this study.(4)
(b)State one way response bias (such as social desirability bias) could affect the anxiety questionnaire results, and suggest a way to reduce it.(2)
(Total for Question 9 is 6 marks)
Mark scheme · 7.15 Research methods: variables, hypotheses, choosing a statistical test and the sign test

Question 1

  • (a) IV: amount of sleep the previous night (Low Sleep group versus Normal Sleep group) oeB1
  • (a) DV: number of words correctly recalled from the 15-word list oeB1
  • (a) Answer: IV: amount of sleep (Low Sleep vs Normal Sleep group). DV: number of words correctly recalled.
  • (b) independent groups (independent measures) design oeB1
  • (b) Answer: Independent groups (independent measures) design.

Question 2

  • (a) identifies a genuine ethical issue, e.g. confidentiality oeM1
  • (a) explains how it is addressed, e.g. storing questionnaire data anonymously, using participant numbers rather than names oeA1
  • (a) identifies a second genuine ethical issue, e.g. informed consent oeM1
  • (a) explains how it is addressed, e.g. giving participants full information about the study before they agree to take part, and confirming their right to withdraw at any time oeA1
  • (a) Answer: E.g. confidentiality, addressed by anonymising data; and informed consent, addressed by fully briefing participants and confirming their right to withdraw.
  • (b) debriefing allows the researcher to check on participants' wellbeing/psychological state after completing the study oeB1
  • (b) this is especially important here because the topic, anxiety, is personally sensitive, and participants may need reassurance, information, or signposting to support if the study has raised any concerns oeB1
  • (b) Answer: Debriefing lets the researcher check participants' wellbeing and offer support/information, which matters more given the personally sensitive topic of anxiety.

Question 3

  • (a) states a direction, e.g. participants in the Low Sleep group will recall fewer words than participants in the Normal Sleep group oeM1
  • (a) operationalises the IV: specifies the sleep amounts defining each group (less than 5 hours vs 7 to 9 hours) oeA1
  • (a) operationalises the DV: specifies the measure, e.g. number of words correctly recalled from the 15-word list oeA1
  • (a) Answer: Participants who have less than 5 hours' sleep the previous night will correctly recall significantly fewer words from a 15-word list than participants who have 7 to 9 hours' sleep the previous night.
  • (b) states there will be no significant difference between the two groups' recall oeB1
  • (b) attributes any difference found to chance, rather than the manipulated IV oeB1
  • (b) Answer: There will be no significant difference in the number of words correctly recalled between the Low Sleep group and the Normal Sleep group; any difference found will be due to chance.

Question 4

  • (a) identifies a plausible extraneous variable, e.g. time of day the memory test is taken, or participants' caffeine intake oeM1
  • (a) suggests a suitable control, e.g. testing all participants at the same time of day oeA1
  • (a) explains why this controls the variable: it cannot then differ systematically between the two groups and confound the results oeA1
  • (a) Answer: E.g. time of day the test is taken; controlled by testing all participants at the same time of day, so it cannot confound the results.
  • (b) strength: no order effects (e.g. practice or fatigue from doing the memory test twice), since each participant only takes part in one condition oeM1
  • (b) limitation: participant variables (e.g. natural differences in memory ability) are not controlled, since different people make up each group oeA1
  • (b) explains that this could confound the results if, by chance, one group happens to contain participants with generally better memories oeA1
  • (b) Answer: Strength: no order effects, since each participant does the test only once. Limitation: participant variables are not controlled between the two different groups of people.

Question 5

  • (a) Chi-Squared test of association caoB1
  • (a) justifies using an independent groups design oeM1
  • (a) justifies using nominal/categorical data, correct or incorrect counts oeA1
  • (a) Answer: Chi-Squared test of association - an independent groups design with nominal (categorical) data.
  • (b) Spearman's rank correlation coefficient caoB1
  • (b) justifies using a correlation between two co-variables oeM1
  • (b) justifies using ordinal-level data oeA1
  • (b) Answer: Spearman's rank correlation coefficient - a correlation using ordinal data.
  • (c) Wilcoxon signed-rank test caoB1
  • (c) justifies using a repeated measures design, the same participants tested twice oeM1
  • (c) justifies using interval data that is not normally distributed oeA1
  • (c) Answer: Wilcoxon signed-rank test - a repeated measures design with interval data that is not normally distributed.

Question 6

  • (a) states a direction: anxiety scores will be lower after the intervention than before oeM1
  • (a) operationalises both measures, referring to the 0 to 20 anxiety questionnaire score taken before and after the intervention oeA1
  • (a) Answer: Participants' scores on the 0 to 20 anxiety questionnaire will be significantly lower after the two-week mindfulness intervention than before it.
  • (b) correctly identifies the signs: participant 1 -, 2 +, 3 -, 4 0, 5 -, 6 -, 7 +, 8 -, 9 -, 10 -, 11 -, 12 - oeB1
  • (b) identifies participant 4 as excluded, since their score showed no change (a zero difference) oeB1
  • (b) states n = 11 caoB1
  • (b) Answer: Signs: 1 -, 2 +, 3 -, 4 (excluded, no change), 5 -, 6 -, 7 +, 8 -, 9 -, 10 -, 11 -, 12 -. Participant 4 is excluded; n = 11.

Question 7

  • (a) identifies the less frequent sign: the '+' sign occurs for participants 2 and 7 only, while '-' occurs for the other 9 included participants oeM1
  • (a) S = 2 caoA1
  • (a) Answer: S = 2.
  • (b) states the decision rule: for the sign test, the result is significant only if the calculated value is less than or equal to the critical value oeB1
  • (b) identifies the critical value for n = 11 from the table as 2 oeM1
  • (b) since the calculated value of S (2) is less than or equal to the critical value (2), the result is significant at p < 0.05 (one-tailed); the null hypothesis is rejected oeA1
  • (b) Answer: Critical value = 2. Since S (2) is less than or equal to 2, the result is significant at p < 0.05 (one-tailed); the null hypothesis is rejected.

Question 8

  • (a) identifies that 9 of the 11 included participants showed a decrease oeM1
  • (a) sets up the calculation: (9 / 11) x 100 oeM1
  • (a) = 81.8% (1dp) awrt 81.8A1
  • (a) Answer: 81.8% (1 decimal place).
  • (b) statistical significance means the pattern found is unlikely to have occurred by chance, not that the effect is large or seen in every case oeM1
  • (b) in this data, 2 of the 11 included participants actually showed an increase, not a decrease, in anxiety oeA1
  • (b) so a significant result can still occur even though the effect was not seen in every single participant oeA1
  • (b) Answer: Significance means the pattern is unlikely to be due to chance, not that every participant showed the effect; here, 2 of the 11 participants actually increased.

Question 9

  • (a) strength: a questionnaire can be given to many participants at once, and is quick/cheap to administer and score oeM1
  • (a) explains a benefit of this, e.g. allowing a larger sample to be tested, increasing the reliability/generalisability of the findings oeA1
  • (a) limitation: participants may not always answer honestly, e.g. due to social desirability bias, wanting to appear less anxious than they really are oeM1
  • (a) explains a consequence, e.g. this could reduce the validity of the anxiety scores collected oeA1
  • (a) Answer: Strength: quick and cheap to administer to many participants at once. Limitation: participants may not answer honestly (e.g. social desirability bias), reducing validity.
  • (b) participants may under-report their true level of anxiety, to appear more calm/socially acceptable oeB1
  • (b) suggests a way to reduce this, e.g. assuring participants that their answers are anonymous/confidential oeB1
  • (b) Answer: Participants may under-report anxiety to appear more socially acceptable; assuring anonymity/confidentiality can help reduce this.

Mark your answers

Check answers without an account. Some answers can be checked automatically; use the mark scheme to mark the rest.

Question 1

3 marks
Did your answer earn the marks?

Question 2

6 marks
Did your answer earn the marks?

Question 3

5 marks
Did your answer earn the marks?

Question 4

6 marks
Did your answer earn the marks?

Question 5

9 marks
Did your answer earn the marks?

Question 6

5 marks
Did your answer earn the marks?

Question 7

5 marks
Did your answer earn the marks?

Question 8

6 marks
Did your answer earn the marks?

Question 9

6 marks
Did your answer earn the marks?
Mark my answers

Worksheets are written for Revision Library and come with a full mark scheme; a few English packs quote an out-of-copyright text, and name it on the page. Exam board names and specification codes say which qualification a pack suits: we are not affiliated with, endorsed by or approved by any exam board, and no past-paper question is reproduced here. Rights queries: hello@revisionlibrary.co.uk