Research methods: variables, hypotheses, choosing a statistical test and the sign test - Worksheets, Questions and Revision
9 original exam-style questions - 7 pages of questions with a full mark scheme - free printable PDF.
Research methods: variables, hypotheses, choosing a statistical test and the sign test revision guideWrite-in editionMore A Level Psychology practiceMock exams
This topic is chapter 2 of A Level Psychology Topic Workbook 4 and chapter 21 of A Level Psychology 10-Minute Tests 2.
7.15 Research methods: variables, hypotheses, choosing a statistical test and the sign test
| Design | Nominal data | Ordinal/interval data (not normally distributed) | Interval/ratio data (normally distributed) |
|---|---|---|---|
| Independent groups | Chi-Squared test of association | Mann-Whitney U test | Unrelated (independent) t-test |
| Repeated measures / matched pairs | Sign test | Wilcoxon signed-rank test | Related (paired) t-test |
| Correlation between two co-variables | not applicable | Spearman's rank correlation coefficient | Pearson's product-moment correlation coefficient |
Use the table above to answer the three scenarios below.
| Participant | Anxiety score before | Anxiety score after |
|---|---|---|
| 1 | 15 | 10 |
| 2 | 12 | 13 |
| 3 | 18 | 11 |
| 4 | 9 | 9 |
| 5 | 14 | 8 |
| 6 | 16 | 9 |
| 7 | 11 | 15 |
| 8 | 13 | 7 |
| 9 | 17 | 12 |
| 10 | 10 | 6 |
| 11 | 15 | 11 |
| 12 | 12 | 5 |
| n (after excluding any tied/zero differences) | Critical value of S (p < 0.05, one-tailed) |
|---|---|
| 5 | 0 |
| 6 | 0 |
| 7 | 0 |
| 8 | 1 |
| 9 | 1 |
| 10 | 1 |
| 11 | 2 |
| 12 | 2 |
| 13 | 3 |
| 14 | 3 |
| 15 | 3 |
For the sign test, the result is significant only if the calculated value of S is less than or equal to the critical value shown for that value of n.
Question 1
- (a) IV: amount of sleep the previous night (Low Sleep group versus Normal Sleep group) oeB1
- (a) DV: number of words correctly recalled from the 15-word list oeB1
- (a) Answer: IV: amount of sleep (Low Sleep vs Normal Sleep group). DV: number of words correctly recalled.
- (b) independent groups (independent measures) design oeB1
- (b) Answer: Independent groups (independent measures) design.
Question 2
- (a) identifies a genuine ethical issue, e.g. confidentiality oeM1
- (a) explains how it is addressed, e.g. storing questionnaire data anonymously, using participant numbers rather than names oeA1
- (a) identifies a second genuine ethical issue, e.g. informed consent oeM1
- (a) explains how it is addressed, e.g. giving participants full information about the study before they agree to take part, and confirming their right to withdraw at any time oeA1
- (a) Answer: E.g. confidentiality, addressed by anonymising data; and informed consent, addressed by fully briefing participants and confirming their right to withdraw.
- (b) debriefing allows the researcher to check on participants' wellbeing/psychological state after completing the study oeB1
- (b) this is especially important here because the topic, anxiety, is personally sensitive, and participants may need reassurance, information, or signposting to support if the study has raised any concerns oeB1
- (b) Answer: Debriefing lets the researcher check participants' wellbeing and offer support/information, which matters more given the personally sensitive topic of anxiety.
Question 3
- (a) states a direction, e.g. participants in the Low Sleep group will recall fewer words than participants in the Normal Sleep group oeM1
- (a) operationalises the IV: specifies the sleep amounts defining each group (less than 5 hours vs 7 to 9 hours) oeA1
- (a) operationalises the DV: specifies the measure, e.g. number of words correctly recalled from the 15-word list oeA1
- (a) Answer: Participants who have less than 5 hours' sleep the previous night will correctly recall significantly fewer words from a 15-word list than participants who have 7 to 9 hours' sleep the previous night.
- (b) states there will be no significant difference between the two groups' recall oeB1
- (b) attributes any difference found to chance, rather than the manipulated IV oeB1
- (b) Answer: There will be no significant difference in the number of words correctly recalled between the Low Sleep group and the Normal Sleep group; any difference found will be due to chance.
Question 4
- (a) identifies a plausible extraneous variable, e.g. time of day the memory test is taken, or participants' caffeine intake oeM1
- (a) suggests a suitable control, e.g. testing all participants at the same time of day oeA1
- (a) explains why this controls the variable: it cannot then differ systematically between the two groups and confound the results oeA1
- (a) Answer: E.g. time of day the test is taken; controlled by testing all participants at the same time of day, so it cannot confound the results.
- (b) strength: no order effects (e.g. practice or fatigue from doing the memory test twice), since each participant only takes part in one condition oeM1
- (b) limitation: participant variables (e.g. natural differences in memory ability) are not controlled, since different people make up each group oeA1
- (b) explains that this could confound the results if, by chance, one group happens to contain participants with generally better memories oeA1
- (b) Answer: Strength: no order effects, since each participant does the test only once. Limitation: participant variables are not controlled between the two different groups of people.
Question 5
- (a) Chi-Squared test of association caoB1
- (a) justifies using an independent groups design oeM1
- (a) justifies using nominal/categorical data, correct or incorrect counts oeA1
- (a) Answer: Chi-Squared test of association - an independent groups design with nominal (categorical) data.
- (b) Spearman's rank correlation coefficient caoB1
- (b) justifies using a correlation between two co-variables oeM1
- (b) justifies using ordinal-level data oeA1
- (b) Answer: Spearman's rank correlation coefficient - a correlation using ordinal data.
- (c) Wilcoxon signed-rank test caoB1
- (c) justifies using a repeated measures design, the same participants tested twice oeM1
- (c) justifies using interval data that is not normally distributed oeA1
- (c) Answer: Wilcoxon signed-rank test - a repeated measures design with interval data that is not normally distributed.
Question 6
- (a) states a direction: anxiety scores will be lower after the intervention than before oeM1
- (a) operationalises both measures, referring to the 0 to 20 anxiety questionnaire score taken before and after the intervention oeA1
- (a) Answer: Participants' scores on the 0 to 20 anxiety questionnaire will be significantly lower after the two-week mindfulness intervention than before it.
- (b) correctly identifies the signs: participant 1 -, 2 +, 3 -, 4 0, 5 -, 6 -, 7 +, 8 -, 9 -, 10 -, 11 -, 12 - oeB1
- (b) identifies participant 4 as excluded, since their score showed no change (a zero difference) oeB1
- (b) states n = 11 caoB1
- (b) Answer: Signs: 1 -, 2 +, 3 -, 4 (excluded, no change), 5 -, 6 -, 7 +, 8 -, 9 -, 10 -, 11 -, 12 -. Participant 4 is excluded; n = 11.
Question 7
- (a) identifies the less frequent sign: the '+' sign occurs for participants 2 and 7 only, while '-' occurs for the other 9 included participants oeM1
- (a) S = 2 caoA1
- (a) Answer: S = 2.
- (b) states the decision rule: for the sign test, the result is significant only if the calculated value is less than or equal to the critical value oeB1
- (b) identifies the critical value for n = 11 from the table as 2 oeM1
- (b) since the calculated value of S (2) is less than or equal to the critical value (2), the result is significant at p < 0.05 (one-tailed); the null hypothesis is rejected oeA1
- (b) Answer: Critical value = 2. Since S (2) is less than or equal to 2, the result is significant at p < 0.05 (one-tailed); the null hypothesis is rejected.
Question 8
- (a) identifies that 9 of the 11 included participants showed a decrease oeM1
- (a) sets up the calculation: (9 / 11) x 100 oeM1
- (a) = 81.8% (1dp) awrt 81.8A1
- (a) Answer: 81.8% (1 decimal place).
- (b) statistical significance means the pattern found is unlikely to have occurred by chance, not that the effect is large or seen in every case oeM1
- (b) in this data, 2 of the 11 included participants actually showed an increase, not a decrease, in anxiety oeA1
- (b) so a significant result can still occur even though the effect was not seen in every single participant oeA1
- (b) Answer: Significance means the pattern is unlikely to be due to chance, not that every participant showed the effect; here, 2 of the 11 participants actually increased.
Question 9
- (a) strength: a questionnaire can be given to many participants at once, and is quick/cheap to administer and score oeM1
- (a) explains a benefit of this, e.g. allowing a larger sample to be tested, increasing the reliability/generalisability of the findings oeA1
- (a) limitation: participants may not always answer honestly, e.g. due to social desirability bias, wanting to appear less anxious than they really are oeM1
- (a) explains a consequence, e.g. this could reduce the validity of the anxiety scores collected oeA1
- (a) Answer: Strength: quick and cheap to administer to many participants at once. Limitation: participants may not answer honestly (e.g. social desirability bias), reducing validity.
- (b) participants may under-report their true level of anxiety, to appear more calm/socially acceptable oeB1
- (b) suggests a way to reduce this, e.g. assuring participants that their answers are anonymous/confidential oeB1
- (b) Answer: Participants may under-report anxiety to appear more socially acceptable; assuring anonymity/confidentiality can help reduce this.
Mark your answers
Check answers without an account. Some answers can be checked automatically; use the mark scheme to mark the rest.