TY - JOUR
T1 - Quantitative content analysis procedures to analyse students' reflective essays
T2 - A methodological review of psychometric and edumetric aspects
AU - Poldner, E.
AU - Simons, P. R.J.
AU - Wijngaards, G.
AU - van der Schaaf, M. F.
PY - 2012
Y1 - 2012
N2 - Reflective essays are a common way to develop higher education students' reflection ability. Researchers frequently analyse reflective essays based on quantitative content analysis procedures (QCA). However, the quality criteria that should be met in QCA are not straightforward. This article aims to: (1) develop a framework of quality requirements for QCA; and (2) explore the extent to which QCA studies of students' reflective essays meet these quality requirements. First, a methodological review of psychometric and edumetric criteria for QCA is conducted, resulting in a framework with required quality criteria. Second, 18 studies were selected in which QCA was used to analyse students' reflective essays. These studies were scrutinised using the developed framework. The results showed that none of the selected studies met all requirements. It is concluded that QCA procedures for analysing students' reflective essays need improvement and that the developed framework can be used to improve and evaluate these procedures.
AB - Reflective essays are a common way to develop higher education students' reflection ability. Researchers frequently analyse reflective essays based on quantitative content analysis procedures (QCA). However, the quality criteria that should be met in QCA are not straightforward. This article aims to: (1) develop a framework of quality requirements for QCA; and (2) explore the extent to which QCA studies of students' reflective essays meet these quality requirements. First, a methodological review of psychometric and edumetric criteria for QCA is conducted, resulting in a framework with required quality criteria. Second, 18 studies were selected in which QCA was used to analyse students' reflective essays. These studies were scrutinised using the developed framework. The results showed that none of the selected studies met all requirements. It is concluded that QCA procedures for analysing students' reflective essays need improvement and that the developed framework can be used to improve and evaluate these procedures.
KW - Content analysis procedure
KW - Edumetrics
KW - Psychometrics
KW - Reflection
KW - Validity
UR - https://www.scopus.com/pages/publications/84856233971
U2 - 10.1016/j.edurev.2011.11.002
DO - 10.1016/j.edurev.2011.11.002
M3 - Review article
AN - SCOPUS:84856233971
SN - 1747-938X
VL - 7
SP - 19
EP - 37
JO - Educational research review
JF - Educational research review
IS - 1
ER -