Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)

Annette M. O’Connor; Justin Clark; James Thomas; René Spijker; Wojciech Kusa; Vickie R. Walker; Melissa Bond

doi:10.1186/s13643-024-02666-2

Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)

Annette M. O’Connor^*, Justin Clark, James Thomas, René Spijker, Wojciech Kusa, Vickie R. Walker, Melissa Bond

^*Corresponding author for this work

Research output: Contribution to journal › Comment/Letter to the editor › Academic › peer-review

1 Downloads (Pure)

Abstract

The eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR) was held on September 7 and 8, 2023, at the University College London, London, England. ICASR is an interdisciplinary group whose goal is to maximize the use of technology for conducting rapid, accurate, and efficient evidence synthesis, e.g., systematic reviews, evidence maps, and scoping reviews of scientific evidence. In 2023, the major themes discussed were understanding the benefits and harms of automation tools that have become available in recent years, the advantages and disadvantages of large language models in evidence synthesis, and approaches to ensuring the validity of tools for the proposed task.

Original language	English
Article number	290
Journal	Systematic Reviews
Volume	13
Issue number	1
DOIs	https://doi.org/10.1186/s13643-024-02666-2
Publication status	Published - 27 Nov 2024
Externally published	Yes

Keywords

Automation tools
ChatGPT
Evidence synthesis
Large language models
Systematic reviews

Access to Document

10.1186/s13643-024-02666-2Licence: CC BY-NC-ND

s13643-024-02666-2Final published version, 999 KBLicence: CC BY-NC-ND

Fingerprint

Dive into the research topics of 'Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)'. Together they form a unique fingerprint.

Cite this

O’Connor, A. M., Clark, J., Thomas, J., Spijker, R., Kusa, W., Walker, V. R., & Bond, M. (2024). Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews, 13(1), Article 290. https://doi.org/10.1186/s13643-024-02666-2

@article{c010f32e304c44eab7c6303b766ea615,

title = "Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)",

abstract = "The eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR) was held on September 7 and 8, 2023, at the University College London, London, England. ICASR is an interdisciplinary group whose goal is to maximize the use of technology for conducting rapid, accurate, and efficient evidence synthesis, e.g., systematic reviews, evidence maps, and scoping reviews of scientific evidence. In 2023, the major themes discussed were understanding the benefits and harms of automation tools that have become available in recent years, the advantages and disadvantages of large language models in evidence synthesis, and approaches to ensuring the validity of tools for the proposed task.",

keywords = "Automation tools, ChatGPT, Evidence synthesis, Large language models, Systematic reviews",

author = "O{\textquoteright}Connor, \{Annette M.\} and Justin Clark and James Thomas and Ren{\'e} Spijker and Wojciech Kusa and Walker, \{Vickie R.\} and Melissa Bond",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.",

year = "2024",

month = nov,

day = "27",

doi = "10.1186/s13643-024-02666-2",

language = "English",

volume = "13",

journal = "Systematic Reviews",

issn = "2046-4053",

publisher = "BioMed Central",

number = "1",

}

O’Connor, AM, Clark, J, Thomas, J, Spijker, R, Kusa, W, Walker, VR & Bond, M 2024, 'Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)', Systematic Reviews, vol. 13, no. 1, 290. https://doi.org/10.1186/s13643-024-02666-2

Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR). / O’Connor, Annette M.; Clark, Justin; Thomas, James et al.
In: Systematic Reviews, Vol. 13, No. 1, 290, 27.11.2024.

Research output: Contribution to journal › Comment/Letter to the editor › Academic › peer-review

TY - JOUR

T1 - Large language models, updates, and evaluation of automation tools for systematic reviews

T2 - a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)

AU - O’Connor, Annette M.

AU - Clark, Justin

AU - Thomas, James

AU - Spijker, René

AU - Kusa, Wojciech

AU - Walker, Vickie R.

AU - Bond, Melissa

N1 - Publisher Copyright: © The Author(s) 2024.

PY - 2024/11/27

Y1 - 2024/11/27

N2 - The eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR) was held on September 7 and 8, 2023, at the University College London, London, England. ICASR is an interdisciplinary group whose goal is to maximize the use of technology for conducting rapid, accurate, and efficient evidence synthesis, e.g., systematic reviews, evidence maps, and scoping reviews of scientific evidence. In 2023, the major themes discussed were understanding the benefits and harms of automation tools that have become available in recent years, the advantages and disadvantages of large language models in evidence synthesis, and approaches to ensuring the validity of tools for the proposed task.

AB - The eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR) was held on September 7 and 8, 2023, at the University College London, London, England. ICASR is an interdisciplinary group whose goal is to maximize the use of technology for conducting rapid, accurate, and efficient evidence synthesis, e.g., systematic reviews, evidence maps, and scoping reviews of scientific evidence. In 2023, the major themes discussed were understanding the benefits and harms of automation tools that have become available in recent years, the advantages and disadvantages of large language models in evidence synthesis, and approaches to ensuring the validity of tools for the proposed task.

KW - Automation tools

KW - ChatGPT

KW - Evidence synthesis

KW - Large language models

KW - Systematic reviews

UR - https://www.scopus.com/pages/publications/85210471999

U2 - 10.1186/s13643-024-02666-2

DO - 10.1186/s13643-024-02666-2

M3 - Comment/Letter to the editor

C2 - 39605097

AN - SCOPUS:85210471999

SN - 2046-4053

VL - 13

JO - Systematic Reviews

JF - Systematic Reviews

IS - 1

M1 - 290

ER -

O’Connor AM, Clark J, Thomas J, Spijker R, Kusa W, Walker VR et al. Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews. 2024 Nov 27;13(1):290. doi: 10.1186/s13643-024-02666-2

Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this