Muhammad Safdar, Nadeem Siddique, Ayesha Gulzar, Haisim Yasin, Ajmal Khan
{"title":"Does ChatGPT generate fake results? Challenges in retrieving content through ChatGPT","authors":"Muhammad Safdar, Nadeem Siddique, Ayesha Gulzar, Haisim Yasin, Ajmal Khan","doi":"10.1108/dlp-01-2024-0006","DOIUrl":null,"url":null,"abstract":"<h3>Purpose</h3>\n<p>ChatGPT is a new development in this technological era. This artificial intelligence-based tool responds to individuals’ queries and produces the requested content within seconds. Therefore, it is becoming popular among academics, the research community and library professionals. This study aims to test (through personal interaction with the tool) the authenticity of the ChatGPT’s produced records. Another objective of the research is to check the relevance between the individuals’ queries and the tool’s results. The research also intends to identify the challenges in retrieving information through ChatGPT.</p><!--/ Abstract__block -->\n<h3>Design/methodology/approach</h3>\n<p>The five researchers from different countries and organizations experienced ChatGPT by asking questions on more than 70 subjects. The responses were recorded in Notepad and converted into MS Excel and MS Access to standardize and analyze the data. The investigators consulted 11 reputed databases/sources, including Web of Science and Scopus, to assess the authenticity of the data retrieved through ChatGPT.</p><!--/ Abstract__block -->\n<h3>Findings</h3>\n<p>The findings confirmed that over 90% of results produced by ChatGPT were fake (the information did not exist in the literature). Similarly, the study sheds light on the discrepancies, such as irrelevant and incomplete information in the data generated by ChatGPT.</p><!--/ Abstract__block -->\n<h3>Originality/value</h3>\n<p>This is a unique study that shares the findings based on the different regions’ researchers’ personal experiences with ChatGPT. The researchers covered different subject areas (above 70) while asking questions to ChatGPT. The paper shares implications for researchers, students, faculty members, academic/research organizations and policymakers.</p><!--/ Abstract__block -->","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1108/dlp-01-2024-0006","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
ChatGPT is a new development in this technological era. This artificial intelligence-based tool responds to individuals’ queries and produces the requested content within seconds. Therefore, it is becoming popular among academics, the research community and library professionals. This study aims to test (through personal interaction with the tool) the authenticity of the ChatGPT’s produced records. Another objective of the research is to check the relevance between the individuals’ queries and the tool’s results. The research also intends to identify the challenges in retrieving information through ChatGPT.
Design/methodology/approach
The five researchers from different countries and organizations experienced ChatGPT by asking questions on more than 70 subjects. The responses were recorded in Notepad and converted into MS Excel and MS Access to standardize and analyze the data. The investigators consulted 11 reputed databases/sources, including Web of Science and Scopus, to assess the authenticity of the data retrieved through ChatGPT.
Findings
The findings confirmed that over 90% of results produced by ChatGPT were fake (the information did not exist in the literature). Similarly, the study sheds light on the discrepancies, such as irrelevant and incomplete information in the data generated by ChatGPT.
Originality/value
This is a unique study that shares the findings based on the different regions’ researchers’ personal experiences with ChatGPT. The researchers covered different subject areas (above 70) while asking questions to ChatGPT. The paper shares implications for researchers, students, faculty members, academic/research organizations and policymakers.
期刊介绍：
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
