TY - JOUR
T1 - The Intrarater and Interrater Reliability of the OMT Classification Among Physicians With a Different Background
AU - Ten Cate, Feikje Julia
AU - Don Griot, Johan Peter William
AU - Alewijnse, Juul Vera
AU - Alsem, Mattijs Willibrord
AU - Warnink-Kavelaars, Jessica
AU - van der Zeeuw, Frederique Theresia
AU - Dekker, Sarah
AU - Lachkar, Nadia
AU - van Doesburg, Margriet Harmke Maria
N1 - Publisher Copyright:
Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.
PY - 2024/8
Y1 - 2024/8
N2 - Background: The Oberg-Manske-Tonkin (OMT) classification established excellent reliability scores in several validation studies. However, one study published in 2022 found much lower scores in a subanalysis of their sample when very simple anomalies were excluded. Our study assessed the reliability of the OMT among physicians with a different background, all involved in congenital hand anomaly care, and analyzed codes with less agreement. Time required for classification was recorded to give an indication on its usability. Methods: One hundred digital cases were classified twice with a minimal 1-month time interval, with the use of the 2020 version of the OMT. Two pediatric hand surgeons, 2 rehabilitation specialists, and 2 plastic surgery residents participated in this reliability analysis. The use of multiple codes was allowed. The intra- and interrater reliability was assessed for all 15 possible rater couples by calculating percentage of agreement. Cohen's kappa was calculated along with a 95% confidence interval. For the analysis of individual codes with less agreement, we calculated positive agreement with the use of a summed agreement table. Time necessary for classification was documented in seconds. Results: The inter- and intrarater agreement was moderate with a mean Cohen's kappa of 0.45 and 0.60 retrospectively. On average, 39 seconds per case were necessary for the first and 24 seconds for the second rating. Background did not influence the level of agreement. Lowest agreement levels (ie, lowest positive agreement) were observed with all the arthrogryposis multiplex congenita subgroups, the "other"subgroups of isolated congenital contractures, syndromic syndactyly, and synpolydactyly. Codes commonly used interchangeably were symbrachydactyly and transverse deficiency and the distinction between these anomalies of only the hand or the entire upper limb; symbrachydactyly and brachydactyly; and camptodactyly and distal arthrogryposis. Conclusions: Our study showed a moderate reliability, emphasizing the complexity of this heterogeneous patient population. Despite its imperfections, the OMT remains the best and most versatile classification tool at hand. Its main purpose may lie in contributing to a universal language for research.
AB - Background: The Oberg-Manske-Tonkin (OMT) classification established excellent reliability scores in several validation studies. However, one study published in 2022 found much lower scores in a subanalysis of their sample when very simple anomalies were excluded. Our study assessed the reliability of the OMT among physicians with a different background, all involved in congenital hand anomaly care, and analyzed codes with less agreement. Time required for classification was recorded to give an indication on its usability. Methods: One hundred digital cases were classified twice with a minimal 1-month time interval, with the use of the 2020 version of the OMT. Two pediatric hand surgeons, 2 rehabilitation specialists, and 2 plastic surgery residents participated in this reliability analysis. The use of multiple codes was allowed. The intra- and interrater reliability was assessed for all 15 possible rater couples by calculating percentage of agreement. Cohen's kappa was calculated along with a 95% confidence interval. For the analysis of individual codes with less agreement, we calculated positive agreement with the use of a summed agreement table. Time necessary for classification was documented in seconds. Results: The inter- and intrarater agreement was moderate with a mean Cohen's kappa of 0.45 and 0.60 retrospectively. On average, 39 seconds per case were necessary for the first and 24 seconds for the second rating. Background did not influence the level of agreement. Lowest agreement levels (ie, lowest positive agreement) were observed with all the arthrogryposis multiplex congenita subgroups, the "other"subgroups of isolated congenital contractures, syndromic syndactyly, and synpolydactyly. Codes commonly used interchangeably were symbrachydactyly and transverse deficiency and the distinction between these anomalies of only the hand or the entire upper limb; symbrachydactyly and brachydactyly; and camptodactyly and distal arthrogryposis. Conclusions: Our study showed a moderate reliability, emphasizing the complexity of this heterogeneous patient population. Despite its imperfections, the OMT remains the best and most versatile classification tool at hand. Its main purpose may lie in contributing to a universal language for research.
KW - OMT classification
KW - Oberg-Manske-Tonkin
KW - reliability
KW - CULAs
KW - congenital anomaly
UR - http://www.scopus.com/inward/record.url?scp=85198343016&partnerID=8YFLogxK
U2 - 10.1097/BPO.0000000000002705
DO - 10.1097/BPO.0000000000002705
M3 - Article
C2 - 38666494
SN - 0271-6798
VL - 44
SP - e662-e667
JO - Journal of Pediatric Orthopedics
JF - Journal of Pediatric Orthopedics
IS - 7
ER -