Leveraging Large Language Models for Literature Review Tasks - A Case Study Using ChatGPT

Research output: Chapter in Book/Report/Conference proceedingsConference contributionpeer-review

Abstract

Literature reviews constitute an indispensable component of research endeavors; however, they often prove laborious and time-intensive. This study explores the potential of ChatGPT, a prominent large-scale language model, to facilitate the literature review process. By contrasting outcomes from a manual literature review with those achieved using ChatGPT, we ascertain the accuracy of ChatGPT's responses. Our findings indicate that ChatGPT aids researchers in swiftly perusing vast and heterogeneous collections of scientific publications, enabling them to extract pertinent information related to their research topic with an overall accuracy of 70%. Moreover, we demonstrate that ChatGPT offers a more economical and expeditious means of achieving this level of accuracy compared to human researchers. Nevertheless, we conclude that although ChatGPT exhibits promise in generating a rapid and cost-effective general overview of a subject, it presently falls short of generating a comprehensive literature overview requisite for scientific applications. Lastly, we propose avenues for future research to enhance the performance and utility of ChatGPT as a literature review assistant.

Original languageEnglish
Title of host publicationAdvanced Research in Technologies, Information, Innovation and Sustainability - 3rd International Conference, ARTIIS 2023, Proceedings
EditorsTeresa Guarda, Filipe Portela, Jose Maria Diaz-Nafria
PublisherSpringer
Pages313-323
Number of pages11
ISBN (Print)9783031488573
DOIs
Publication statusPublished - 2023
Event3rd International Conference on Advanced Research in Technologies, Information, Innovation and Sustainability, ARTIIS 2023 - Madrid, Spain
Duration: 18 Oct 202320 Oct 2023

Publication series

NameCommunications in Computer and Information Science
Volume1935 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference3rd International Conference on Advanced Research in Technologies, Information, Innovation and Sustainability, ARTIIS 2023
Country/TerritorySpain
CityMadrid
Period18.10.202320.10.2023

Keywords

  • ChatGPT
  • Large Language Model
  • Literature Review
  • Use Case

Fingerprint

Dive into the research topics of 'Leveraging Large Language Models for Literature Review Tasks - A Case Study Using ChatGPT'. Together they form a unique fingerprint.

Cite this