The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions

Elise V van Wijk; Mario de Jonge; Floris M van Blankenstein; Roemer J Janse; Alexandra M J Langers

doi:10.1186/s12909-024-06538-0

The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions

Elise V van Wijk
, Mario de Jonge
, Floris M van Blankenstein
, Roemer J Janse
, Alexandra M J Langers^*

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

BACKGROUND: Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students' knowledge retention. By analyzing these two formats, we aim to identify the most effective approach to retrieval practice, thereby helping to optimize its implementation and improve learning outcomes.

METHODS: In this randomized within-subjects study, students (n = 45) practiced with both VSAQs and MCQs in an extracurricular lifestyle course, without receiving feedback. The final retention test consisted of identical questions in both formats. A 2 × 2 repeated measures ANOVA was used to determine the effect of question format in practice testing and final test on final test score. Additionally, digital questionnaires were used to explore students' test-taking experiences.

RESULTS: The VSAQs were answered incorrectly more frequently on the practice tests and final test. There was no main effect of practice question format on final test performance, and no interaction effect between question format on the practice and final test. Regardless of question format, most students thought the practice tests were beneficial for learning.

CONCLUSIONS: We found no evidence indicating that either MCQ or VSAQ is more effective for knowledge retention during retrieval practice. The lower initial retrieval success in the VSAQs, indicated by the higher degree of incorrect answers on the practice tests, might have limited their effectiveness during retrieval practice. To optimize the use of VSAQs in retrieval practice, it seems important to improve initial retrieval success to maximize learning outcomes.

CLINICAL TRIAL NUMBER: Not applicable.

Original language	English
Article number	1547
Pages (from-to)	1547
Journal	BMC Medical Education
Volume	24
Issue number	1
DOIs	https://doi.org/10.1186/s12909-024-06538-0
Publication status	Published - 30 Dec 2024
Externally published	Yes

Keywords

Educational Measurement/methods
Female
Humans
Learning
Male
Mental Recall
Retention, Psychology
Surveys and Questionnaires
Young Adult

Access to Document

10.1186/s12909-024-06538-0

Cite this

@article{eb91b0f1c09845968adfc0743bce4e26,

title = "The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions",

abstract = "BACKGROUND: Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students' knowledge retention. By analyzing these two formats, we aim to identify the most effective approach to retrieval practice, thereby helping to optimize its implementation and improve learning outcomes.METHODS: In this randomized within-subjects study, students (n = 45) practiced with both VSAQs and MCQs in an extracurricular lifestyle course, without receiving feedback. The final retention test consisted of identical questions in both formats. A 2 × 2 repeated measures ANOVA was used to determine the effect of question format in practice testing and final test on final test score. Additionally, digital questionnaires were used to explore students' test-taking experiences.RESULTS: The VSAQs were answered incorrectly more frequently on the practice tests and final test. There was no main effect of practice question format on final test performance, and no interaction effect between question format on the practice and final test. Regardless of question format, most students thought the practice tests were beneficial for learning.CONCLUSIONS: We found no evidence indicating that either MCQ or VSAQ is more effective for knowledge retention during retrieval practice. The lower initial retrieval success in the VSAQs, indicated by the higher degree of incorrect answers on the practice tests, might have limited their effectiveness during retrieval practice. To optimize the use of VSAQs in retrieval practice, it seems important to improve initial retrieval success to maximize learning outcomes.CLINICAL TRIAL NUMBER: Not applicable.",

keywords = "Educational Measurement/methods, Female, Humans, Learning, Male, Mental Recall, Retention, Psychology, Surveys and Questionnaires, Young Adult",

author = "\{van Wijk\}, \{Elise V\} and \{de Jonge\}, Mario and \{van Blankenstein\}, \{Floris M\} and Janse, \{Roemer J\} and Langers, \{Alexandra M J\}",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",

year = "2024",

month = dec,

day = "30",

doi = "10.1186/s12909-024-06538-0",

language = "English",

volume = "24",

pages = "1547",

journal = "BMC Medical Education",

issn = "1472-6920",

publisher = "BioMed Central Ltd.",

number = "1",

}

TY - JOUR

T1 - The battle of question formats

T2 - a comparative study of retrieval practice using very short answer questions and multiple choice questions

AU - van Wijk, Elise V

AU - de Jonge, Mario

AU - van Blankenstein, Floris M

AU - Janse, Roemer J

AU - Langers, Alexandra M J

N1 - Publisher Copyright: © The Author(s) 2024.

PY - 2024/12/30

Y1 - 2024/12/30

N2 - BACKGROUND: Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students' knowledge retention. By analyzing these two formats, we aim to identify the most effective approach to retrieval practice, thereby helping to optimize its implementation and improve learning outcomes.METHODS: In this randomized within-subjects study, students (n = 45) practiced with both VSAQs and MCQs in an extracurricular lifestyle course, without receiving feedback. The final retention test consisted of identical questions in both formats. A 2 × 2 repeated measures ANOVA was used to determine the effect of question format in practice testing and final test on final test score. Additionally, digital questionnaires were used to explore students' test-taking experiences.RESULTS: The VSAQs were answered incorrectly more frequently on the practice tests and final test. There was no main effect of practice question format on final test performance, and no interaction effect between question format on the practice and final test. Regardless of question format, most students thought the practice tests were beneficial for learning.CONCLUSIONS: We found no evidence indicating that either MCQ or VSAQ is more effective for knowledge retention during retrieval practice. The lower initial retrieval success in the VSAQs, indicated by the higher degree of incorrect answers on the practice tests, might have limited their effectiveness during retrieval practice. To optimize the use of VSAQs in retrieval practice, it seems important to improve initial retrieval success to maximize learning outcomes.CLINICAL TRIAL NUMBER: Not applicable.

AB - BACKGROUND: Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students' knowledge retention. By analyzing these two formats, we aim to identify the most effective approach to retrieval practice, thereby helping to optimize its implementation and improve learning outcomes.METHODS: In this randomized within-subjects study, students (n = 45) practiced with both VSAQs and MCQs in an extracurricular lifestyle course, without receiving feedback. The final retention test consisted of identical questions in both formats. A 2 × 2 repeated measures ANOVA was used to determine the effect of question format in practice testing and final test on final test score. Additionally, digital questionnaires were used to explore students' test-taking experiences.RESULTS: The VSAQs were answered incorrectly more frequently on the practice tests and final test. There was no main effect of practice question format on final test performance, and no interaction effect between question format on the practice and final test. Regardless of question format, most students thought the practice tests were beneficial for learning.CONCLUSIONS: We found no evidence indicating that either MCQ or VSAQ is more effective for knowledge retention during retrieval practice. The lower initial retrieval success in the VSAQs, indicated by the higher degree of incorrect answers on the practice tests, might have limited their effectiveness during retrieval practice. To optimize the use of VSAQs in retrieval practice, it seems important to improve initial retrieval success to maximize learning outcomes.CLINICAL TRIAL NUMBER: Not applicable.

KW - Educational Measurement/methods

KW - Female

KW - Humans

KW - Learning

KW - Male

KW - Mental Recall

KW - Retention, Psychology

KW - Surveys and Questionnaires

KW - Young Adult

U2 - 10.1186/s12909-024-06538-0

DO - 10.1186/s12909-024-06538-0

M3 - Article

C2 - 39734216

SN - 1472-6920

VL - 24

SP - 1547

JO - BMC Medical Education

JF - BMC Medical Education

IS - 1

M1 - 1547

ER -

The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions

Abstract

Keywords

Access to Document

Fingerprint

Cite this