TY - CONF
T1 - Identifying error types in radiological image interpretation of learners
AU - Ravesloot, C.
AU - van der Gijp, A.
AU - van der Schaaf, Marieke
AU - Huige, J.C.B.M.
AU - ten Cate, O.
AU - Vincken, K.L.
AU - Mol, C.P.
AU - van Schaik, J.P.J.
PY - 2015/6/3
Y1 - 2015/6/3
N2 - RationaleErrors occur in different phases of the image interpretation process of learners. Insight in the error types made by learners is crucial for giving effective feedback. Using a step-by-step-questions assessment procedure to identify error types in image interpretation and reveal partial knowledge of or hidden errors in the interpretation process, we investigated which error types can be identified in the image interpretation process of radiology clerks and the reliability of this procedure in terms of inter-rater agreement.MethodsHundred-nine radiology clerks took a radiology image interpretation test consisting of ten CT image cases and one to three X-ray cases. The image interpretation questions concerned step-by-step questions: labelling an abnormality (perception), describing the abnormality (analysis) and giving a diagnosis and/or advice (synthesis) (1). Errors were coded as perception, analysis, synthesis or undefined errors by two independent observers. A hidden error was identified if a correct diagnosis was given, based on an incorrect perception or analysis. Partial knowledge was identified if an incorrect diagnosis was given based on a correct perception and/or analysis. Consensus was reached after discussion, in case of discrepancies. Prevalence of error types and inter-rater reliability of the procedure were calculated. ResultsWith our step-by-step questions procedure applied to 1351 cases, 831 errors were identified. 638 errors were found in the process of image interpretation (77%), of which 29.6% were perception errors, 15.7% analysis errors and 31.7% synthesis errors. The step-by-step questions revealed hidden errors in 125 cases (9%) and partial knowledge in 243 cases (18%). We found a mean inter-rater reliability of Cohen’s κ = 0.8.ConclusionsA step-by-step question approach can reliably distinguish perception, analysis and synthesis errors. Besides, the approach reveals hidden errors and partial knowledge of students. References [1] van der Gijp A, van der Schaaf MF, van der Schaaf IC, Huige JC, Ravesloot CJ, van Schaik JP, et al. Interpretation of radiological images: towards a framework of knowledge and skills. Adv Health Sci Educ Theory Pract. 2014 Jan 22.
AB - RationaleErrors occur in different phases of the image interpretation process of learners. Insight in the error types made by learners is crucial for giving effective feedback. Using a step-by-step-questions assessment procedure to identify error types in image interpretation and reveal partial knowledge of or hidden errors in the interpretation process, we investigated which error types can be identified in the image interpretation process of radiology clerks and the reliability of this procedure in terms of inter-rater agreement.MethodsHundred-nine radiology clerks took a radiology image interpretation test consisting of ten CT image cases and one to three X-ray cases. The image interpretation questions concerned step-by-step questions: labelling an abnormality (perception), describing the abnormality (analysis) and giving a diagnosis and/or advice (synthesis) (1). Errors were coded as perception, analysis, synthesis or undefined errors by two independent observers. A hidden error was identified if a correct diagnosis was given, based on an incorrect perception or analysis. Partial knowledge was identified if an incorrect diagnosis was given based on a correct perception and/or analysis. Consensus was reached after discussion, in case of discrepancies. Prevalence of error types and inter-rater reliability of the procedure were calculated. ResultsWith our step-by-step questions procedure applied to 1351 cases, 831 errors were identified. 638 errors were found in the process of image interpretation (77%), of which 29.6% were perception errors, 15.7% analysis errors and 31.7% synthesis errors. The step-by-step questions revealed hidden errors in 125 cases (9%) and partial knowledge in 243 cases (18%). We found a mean inter-rater reliability of Cohen’s κ = 0.8.ConclusionsA step-by-step question approach can reliably distinguish perception, analysis and synthesis errors. Besides, the approach reveals hidden errors and partial knowledge of students. References [1] van der Gijp A, van der Schaaf MF, van der Schaaf IC, Huige JC, Ravesloot CJ, van Schaik JP, et al. Interpretation of radiological images: towards a framework of knowledge and skills. Adv Health Sci Educ Theory Pract. 2014 Jan 22.
M3 - Paper
ER -