Abstract
Background and purpose: The electrocardiogram (ECG) is frequently obtained in the work-up of COVID-19 patients. So far, no study has evaluated whether ECG-based machine learning models have added value to predict in-hospital mortality specifically in COVID-19 patients. Methods: Using data from the CAPACITY-COVID registry, we studied 882 patients admitted with COVID-19 across seven hospitals in the Netherlands. Raw format 12-lead ECGs recorded within 72 h of admission were studied. With data from five hospitals (n = 634), three models were developed: (a) a logistic regression baseline model using age and sex, (b) a least absolute shrinkage and selection operator (LASSO) model using age, sex and human annotated ECG features, and (c) a pre-trained deep neural network (DNN) using age, sex and the raw ECG waveforms. Data from two hospitals (n = 248) was used for external validation. Results: Performances for models a, b and c were comparable with an area under the receiver operating curve of 0.73 (95% confidence interval [CI] 0.65–0.79), 0.76 (95% CI 0.68–0.82) and 0.77 (95% CI 0.70–0.83) respectively. Predictors of mortality in the LASSO model were age, low QRS voltage, ST depression, premature atrial complexes, sex, increased ventricular rate, and right bundle branch block. Conclusion: This study shows that the ECG-based prediction models could be helpful for the initial risk stratification of patients diagnosed with COVID-19, and that several ECG abnormalities are associated with in-hospital all-cause mortality of COVID-19 patients. Moreover, this proof-of-principle study shows that the use of pre-trained DNNs for ECG analysis does not underperform compared with time-consuming manual annotation of ECG features.
Original language | English |
---|---|
Pages (from-to) | 312-318 |
Number of pages | 7 |
Journal | Netherlands Heart Journal |
Volume | 30 |
Issue number | 6 |
DOIs | |
Publication status | Published - Jun 2022 |
Keywords
- Arrhythmia
- COVID-19
- Deep learning
- Electrocardiogram
- Machine learning
- Mortality
Fingerprint
Dive into the research topics of 'Electrocardiogram-based mortality prediction in patients with COVID-19 using machine learning'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver
}
In: Netherlands Heart Journal, Vol. 30, No. 6, 06.2022, p. 312-318.
Research output: Contribution to journal › Article › Academic › peer-review
TY - JOUR
T1 - Electrocardiogram-based mortality prediction in patients with COVID-19 using machine learning
AU - van de Leur, R. R.
AU - Bleijendaal, H.
AU - Taha, K.
AU - Mast, T.
AU - Gho, J. M.I.H.
AU - Linschoten, M.
AU - van Rees, B.
AU - Henkens, M. T.H.M.
AU - Heymans, S.
AU - Sturkenboom, N.
AU - Tio, R. A.
AU - Offerhaus, J. A.
AU - Bor, W. L.
AU - Maarse, M.
AU - Haerkens-Arends, H. E.
AU - Kolk, M. Z.H.
AU - van der Lingen, A. C.J.
AU - Selder, J. J.
AU - Wierda, E. E.
AU - van Bergen, P. F.M.M.
AU - Winter, M. M.
AU - Zwinderman, A. H.
AU - Doevendans, P. A.
AU - van der Harst, P.
AU - Pinto, Y. M.
AU - Asselbergs, F. W.
AU - van Es, R.
AU - Tjong, F. V.Y.
N1 - Funding Information: The CAPACITY-COVID registry is supported by the Dutch Heart Foundation (2020B006 CAPACITY), the EuroQol Research Foundation, Novartis Global, Sanofi Genzyme Europe, Novo Nordisk Nederland, Servier Nederland, and Daiichi Sankyo Nederland. The Dutch Network for Cardiovascular Research (WCN), a partner within the CAPACITY-COVID consortium, received funding from the Dutch Heart Foundation (2020B006 CAPACITY) for site management and logistic support in the Netherlands. R.v.d.L. and R.v.E. are supported by the Netherlands Organisation for Health Research and Development (ZonMw) with grant number 104021004. H.B. is supported by ERN GUARD-Heart and University of Amsterdam Research Priority Area Medical Integromics. F.T. is supported by a personal Rubicon grant from the Dutch Research Council (NWO)/the Netherlands Organisation for Health Research and Development (ZonMw) with grant number 2019-3-452019308, and by personal grants from the Amsterdam Cardiovascular Sciences (ACS). P.D. is supported by the Leducq Foundation CURE-PLaN grant. M.L. is supported by the Alexandre Suerman Stipend of the University Medical Centre Utrecht. F.W.A. is supported by University College London Hospitals National Institute for Health Research Biomedical Research, the EU/EFPIA Innovative Medicines Initiative 2 Joint Undertaking BigData@Heart grant n° 116074 and CardioVasculair Onderzoek Nederland 2015-12 eDETECT. Funding Information: We want to express our gratitude and appreciation to all participating sites and researchers part of the CAPACITY-COVID collaborative consortium. A list of all collaborators within the CAPACITY-COVID consortium and their affiliations is included in the electronic supplementary material. CAPACITY-COVID gratefully acknowledges the following organizations for their assistance in the development of the registry and/or coordination regarding the data registration in the collaborating centres: partners of the Dutch CardioVascular Alliance (DCVA), the Dutch Association of Medical Specialists (FMS), and the British Heart Foundation Centres of Research Excellence. In addition, the consortium is grateful for the endorsement of the CAPACITY-COVID initiative by the European Society of Cardiology (ESC), the European Heart Network (EHN), and the Society for Cardiovascular Magnetic Resonance (SCMR). Furthermore, the consortium appreciates the endorsement of CAPACITY-COVID as a flagship research project within the National Institute for Health Research (NIHR)/British Heart Foundation (BHF) Partnership framework for COVID-19 research. Part of this work is supported by the BigData@Heart Consortium, funded by the Innovative Medicines Initiative‑2 joint undertaking under grant agreement no. 116074. This joint undertaking receives support from the EU’s Horizon 2020 research and innovation programme and EFP IA. Furthermore, we would like to thank Martijn van Eck, Henri van Dalen, Tijs Samson, and Frank van Hooren for their help in the data collection of the Jeroen Bosch Hospital. We also would like to thank Carla van Nes and Aldo Leenders for their contributions to the data collection at the Dijklander Hospital. The CAPACITY-COVID registry is supported by the Dutch Heart Foundation (2020B006 CAPACITY), the EuroQol Research Foundation, Novartis Global, Sanofi Genzyme Europe, Novo Nordisk Nederland, Servier Nederland, and Daiichi Sankyo Nederland. The Dutch Network for Cardiovascular Research (WCN), a partner within the CAPACITY-COVID consortium, received funding from the Dutch Heart Foundation (2020B006 CAPACITY) for site management and logistic support in the Netherlands. R.v.d.L. and R.v.E. are supported by the Netherlands Organisation for Health Research and Development (ZonMw) with grant number 104021004. H.B. is supported by ERN GUARD-Heart and University of Amsterdam Research Priority Area Medical Integromics. F.T. is supported by a personal Rubicon grant from the Dutch Research Council (NWO)/the Netherlands Organisation for Health Research and Development (ZonMw) with grant number 2019-3-452019308, and by personal grants from the Amsterdam Cardiovascular Sciences (ACS). P.D. is supported by the Leducq Foundation CURE-PLaN grant. M.L. is supported by the Alexandre Suerman Stipend of the University Medical Centre Utrecht. F.W.A. is supported by University College London Hospitals National Institute for Health Research Biomedical Research, the EU/EFPIA Innovative Medicines Initiative 2 Joint Undertaking BigData@Heart grant n° 116074 and CardioVasculair Onderzoek Nederland 2015-12 eDETECT. Funding Information: We want to express our gratitude and appreciation to all participating sites and researchers part of the CAPACITY-COVID collaborative consortium. A list of all collaborators within the CAPACITY-COVID consortium and their affiliations is included in the electronic supplementary material. CAPACITY-COVID gratefully acknowledges the following organizations for their assistance in the development of the registry and/or coordination regarding the data registration in the collaborating centres: partners of the Dutch CardioVascular Alliance (DCVA), the Dutch Association of Medical Specialists (FMS), and the British Heart Foundation Centres of Research Excellence. In addition, the consortium is grateful for the endorsement of the CAPACITY-COVID initiative by the European Society of Cardiology (ESC), the European Heart Network (EHN), and the Society for Cardiovascular Magnetic Resonance (SCMR). Furthermore, the consortium appreciates the endorsement of CAPACITY-COVID as a flagship research project within the National Institute for Health Research (NIHR)/British Heart Foundation (BHF) Partnership framework for COVID-19 research. Part of this work is supported by the BigData@Heart Consortium, funded by the Innovative Medicines Initiative‑2 joint undertaking under grant agreement no. 116074. This joint undertaking receives support from the EU’s Horizon 2020 research and innovation programme and EFP IA. Furthermore, we would like to thank Martijn van Eck, Henri van Dalen, Tijs Samson, and Frank van Hooren for their help in the data collection of the Jeroen Bosch Hospital. We also would like to thank Carla van Nes and Aldo Leenders for their contributions to the data collection at the Dijklander Hospital. Funding Information: F.V.Y. Tjong gratefully acknowledges the Dutch Research Council (NWO) for the support through the Rubicon program (grant number 2019-3-452019308) which (partly) financed this project. R.R. van de Leur, H. Bleijendaal, K. Taha, T. Mast, J.M.I.H. Gho, M. Linschoten, B. van Rees, M.T.H.M. Henkens, S. Heymans, N. Sturkenboom, R.A. Tio, J.A. Offerhaus, W.L. Bor, M. Maarse, H.E. Haerkens-Arends, M.Z.H. Kolk, A.C.J. van der Lingen, J.J. Selder, E.E. Wierda, P.F.M.M. van Bergen, M.M. Winter, A.H. Zwinderman, P.A. Doevendans, P. van der Harst, Y.M. Pinto, F.W. Asselbergs and R. van Es declare that they have no competing interests. Publisher Copyright: © 2022, The Author(s).
PY - 2022/6
Y1 - 2022/6
N2 - Background and purpose: The electrocardiogram (ECG) is frequently obtained in the work-up of COVID-19 patients. So far, no study has evaluated whether ECG-based machine learning models have added value to predict in-hospital mortality specifically in COVID-19 patients. Methods: Using data from the CAPACITY-COVID registry, we studied 882 patients admitted with COVID-19 across seven hospitals in the Netherlands. Raw format 12-lead ECGs recorded within 72 h of admission were studied. With data from five hospitals (n = 634), three models were developed: (a) a logistic regression baseline model using age and sex, (b) a least absolute shrinkage and selection operator (LASSO) model using age, sex and human annotated ECG features, and (c) a pre-trained deep neural network (DNN) using age, sex and the raw ECG waveforms. Data from two hospitals (n = 248) was used for external validation. Results: Performances for models a, b and c were comparable with an area under the receiver operating curve of 0.73 (95% confidence interval [CI] 0.65–0.79), 0.76 (95% CI 0.68–0.82) and 0.77 (95% CI 0.70–0.83) respectively. Predictors of mortality in the LASSO model were age, low QRS voltage, ST depression, premature atrial complexes, sex, increased ventricular rate, and right bundle branch block. Conclusion: This study shows that the ECG-based prediction models could be helpful for the initial risk stratification of patients diagnosed with COVID-19, and that several ECG abnormalities are associated with in-hospital all-cause mortality of COVID-19 patients. Moreover, this proof-of-principle study shows that the use of pre-trained DNNs for ECG analysis does not underperform compared with time-consuming manual annotation of ECG features.
AB - Background and purpose: The electrocardiogram (ECG) is frequently obtained in the work-up of COVID-19 patients. So far, no study has evaluated whether ECG-based machine learning models have added value to predict in-hospital mortality specifically in COVID-19 patients. Methods: Using data from the CAPACITY-COVID registry, we studied 882 patients admitted with COVID-19 across seven hospitals in the Netherlands. Raw format 12-lead ECGs recorded within 72 h of admission were studied. With data from five hospitals (n = 634), three models were developed: (a) a logistic regression baseline model using age and sex, (b) a least absolute shrinkage and selection operator (LASSO) model using age, sex and human annotated ECG features, and (c) a pre-trained deep neural network (DNN) using age, sex and the raw ECG waveforms. Data from two hospitals (n = 248) was used for external validation. Results: Performances for models a, b and c were comparable with an area under the receiver operating curve of 0.73 (95% confidence interval [CI] 0.65–0.79), 0.76 (95% CI 0.68–0.82) and 0.77 (95% CI 0.70–0.83) respectively. Predictors of mortality in the LASSO model were age, low QRS voltage, ST depression, premature atrial complexes, sex, increased ventricular rate, and right bundle branch block. Conclusion: This study shows that the ECG-based prediction models could be helpful for the initial risk stratification of patients diagnosed with COVID-19, and that several ECG abnormalities are associated with in-hospital all-cause mortality of COVID-19 patients. Moreover, this proof-of-principle study shows that the use of pre-trained DNNs for ECG analysis does not underperform compared with time-consuming manual annotation of ECG features.
KW - Arrhythmia
KW - COVID-19
KW - Deep learning
KW - Electrocardiogram
KW - Machine learning
KW - Mortality
UR - http://www.scopus.com/inward/record.url?scp=85127123418&partnerID=8YFLogxK
U2 - 10.1007/s12471-022-01670-2
DO - 10.1007/s12471-022-01670-2
M3 - Article
C2 - 35301688
SN - 1568-5888
VL - 30
SP - 312
EP - 318
JO - Netherlands Heart Journal
JF - Netherlands Heart Journal
IS - 6
ER -