TY - JOUR
T1 - Methodology over metrics
T2 - current scientific standards are a disservice to patients and society
AU - Van Calster, Ben
AU - Wynants, Laure
AU - Riley, Richard D.
AU - van Smeden, Maarten
AU - Collins, Gary S.
N1 - Funding Information:
Funding: BVC was supported by Internal Funds KU Leuven (C24M/20/064). Laure Wynants is a postdoctoral fellow of the Research Foundation – Flanders (FWO). GSC was supported by the NIHR Biomedical Research Centre, Oxford, and Cancer Research UK (programme grant: C49297/A27294). The authors confirm that the funders had no role in study conception or manuscript writing.
Funding Information:
Declaration of Competing Interest: BVC reports research grants from Research Foundation – Flanders (FWO) and Internal Funds KU Leuven; LW reports a postdoctoral fellowship from FWO; GSC reports research grants from NIHR Biomedical Research Centre , Oxford, and Cancer Research UK.
Publisher Copyright:
© 2021 The Authors
PY - 2021/10
Y1 - 2021/10
N2 - Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society.
AB - Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society.
KW - Methodology
KW - Reporting
KW - Research quality
UR - http://www.scopus.com/inward/record.url?scp=85111582049&partnerID=8YFLogxK
U2 - 10.1016/j.jclinepi.2021.05.018
DO - 10.1016/j.jclinepi.2021.05.018
M3 - Article
C2 - 34077797
AN - SCOPUS:85111582049
SN - 0895-4356
VL - 138
SP - 219
EP - 226
JO - Journal of Clinical Epidemiology
JF - Journal of Clinical Epidemiology
ER -