TY - JOUR
T1 - The TRIPOD-LLM reporting guideline for studies using large language models
AU - Gallifant, Jack
AU - Afshar, Majid
AU - Ameen, Saleem
AU - Aphinyanaphongs, Yindalon
AU - Chen, Shan
AU - Cacciamani, Giovanni
AU - Demner-Fushman, Dina
AU - Dligach, Dmitriy
AU - Daneshjou, Roxana
AU - Fernandes, Chrystinne
AU - Hansen, Lasse Hyldig
AU - Landman, Adam
AU - Lehmann, Lisa
AU - McCoy, Liam G.
AU - Miller, Timothy
AU - Moreno, Amy
AU - Munch, Nikolaj
AU - Restrepo, David
AU - Savova, Guergana
AU - Umeton, Renato
AU - Gichoya, Judy Wawira
AU - Collins, Gary S.
AU - Moons, Karel G.M.
AU - Celi, Leo A.
AU - Bitterman, Danielle S.
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer Nature America, Inc. 2025.
PY - 2025/1
Y1 - 2025/1
N2 - Large language models (LLMs) are rapidly being adopted in healthcare, necessitating standardized reporting guidelines. We present transparent reporting of a multivariable model for individual prognosis or diagnosis (TRIPOD)-LLM, an extension of the TRIPOD + artificial intelligence statement, addressing the unique challenges of LLMs in biomedical applications. TRIPOD-LLM provides a comprehensive checklist of 19 main items and 50 subitems, covering key aspects from title to discussion. The guidelines introduce a modular format accommodating various LLM research designs and tasks, with 14 main items and 32 subitems applicable across all categories. Developed through an expedited Delphi process and expert consensus, TRIPOD-LLM emphasizes transparency, human oversight and task-specific performance reporting. We also introduce an interactive website ( https://tripod-llm.vercel.app/ ) facilitating easy guideline completion and PDF generation for submission. As a living document, TRIPOD-LLM will evolve with the field, aiming to enhance the quality, reproducibility and clinical applicability of LLM research in healthcare through comprehensive reporting.
AB - Large language models (LLMs) are rapidly being adopted in healthcare, necessitating standardized reporting guidelines. We present transparent reporting of a multivariable model for individual prognosis or diagnosis (TRIPOD)-LLM, an extension of the TRIPOD + artificial intelligence statement, addressing the unique challenges of LLMs in biomedical applications. TRIPOD-LLM provides a comprehensive checklist of 19 main items and 50 subitems, covering key aspects from title to discussion. The guidelines introduce a modular format accommodating various LLM research designs and tasks, with 14 main items and 32 subitems applicable across all categories. Developed through an expedited Delphi process and expert consensus, TRIPOD-LLM emphasizes transparency, human oversight and task-specific performance reporting. We also introduce an interactive website ( https://tripod-llm.vercel.app/ ) facilitating easy guideline completion and PDF generation for submission. As a living document, TRIPOD-LLM will evolve with the field, aiming to enhance the quality, reproducibility and clinical applicability of LLM research in healthcare through comprehensive reporting.
UR - http://www.scopus.com/inward/record.url?scp=85216172212&partnerID=8YFLogxK
U2 - 10.1038/s41591-024-03425-5
DO - 10.1038/s41591-024-03425-5
M3 - Article
C2 - 39779929
AN - SCOPUS:85216172212
SN - 1078-8956
VL - 31
SP - 60
EP - 69
JO - Nature medicine
JF - Nature medicine
IS - 1
ER -