ChatGPT在期刊评估中的诊断可靠性

IF 3.1 Q2 PHARMACOLOGY & PHARMACY

Advanced pharmaceutical bulletin Pub Date : 2023-10-14 DOI:10.34172/apb.2024.020

Mehdi Dadkhah, Marilyn H Oermann, Mihály Hegedüs, Raghu Raman, Lóránt Dénes Dávid

{"title":"ChatGPT在期刊评估中的诊断可靠性","authors":"Mehdi Dadkhah, Marilyn H Oermann, Mihály Hegedüs, Raghu Raman, Lóránt Dénes Dávid","doi":"10.34172/apb.2024.020","DOIUrl":null,"url":null,"abstract":"Purpose: Academic and other researchers have limited tools with which to address the current proliferation of predatory and hijacked journals. These journals can have negative effects on science, research funding, and the dissemination of information. As most predatory and hijacked journals are not error free, this study used ChatGPT, an artificial intelligence technology tool, to conduct an evaluation of journal quality. Methods: Predatory and hijacked journals were analyzed for reliability using ChatGPT, and the reliability of result have been discussed. Results: It shows that ChatGPT is an unreliable tool for journal quality evaluation for both hijacked and predatory journals. Conclusion: To show how address this gap, an early trial version of Journal Checker Chatbot has been developed and is discussed as an alternative chatbot that can assist researchers in detecting hijacked journals.","PeriodicalId":7256,"journal":{"name":"Advanced pharmaceutical bulletin","volume":null,"pages":null},"PeriodicalIF":3.1000,"publicationDate":"2023-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Diagnosis Reliability of ChatGPT for Journal Evaluation\",\"authors\":\"Mehdi Dadkhah, Marilyn H Oermann, Mihály Hegedüs, Raghu Raman, Lóránt Dénes Dávid\",\"doi\":\"10.34172/apb.2024.020\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Purpose: Academic and other researchers have limited tools with which to address the current proliferation of predatory and hijacked journals. These journals can have negative effects on science, research funding, and the dissemination of information. As most predatory and hijacked journals are not error free, this study used ChatGPT, an artificial intelligence technology tool, to conduct an evaluation of journal quality. Methods: Predatory and hijacked journals were analyzed for reliability using ChatGPT, and the reliability of result have been discussed. Results: It shows that ChatGPT is an unreliable tool for journal quality evaluation for both hijacked and predatory journals. Conclusion: To show how address this gap, an early trial version of Journal Checker Chatbot has been developed and is discussed as an alternative chatbot that can assist researchers in detecting hijacked journals.\",\"PeriodicalId\":7256,\"journal\":{\"name\":\"Advanced pharmaceutical bulletin\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2023-10-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced pharmaceutical bulletin\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.34172/apb.2024.020\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PHARMACOLOGY & PHARMACY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced pharmaceutical bulletin","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34172/apb.2024.020","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}

引用次数: 0

摘要

目的:学术界和其他研究人员在应对当前掠夺性和被劫持期刊泛滥的问题上工具有限。这些期刊可能对科学、研究经费和信息传播产生负面影响。由于大多数掠夺性和被劫持的期刊并非没有错误，因此本研究使用人工智能技术工具ChatGPT对期刊质量进行评估。方法:利用ChatGPT对掠夺性和劫持性期刊进行信度分析，并对结果的信度进行讨论。结果:ChatGPT对于被劫持和掠夺性期刊的质量评价都不是一个可靠的工具。结论:为了展示如何解决这一差距，我们开发了一个早期的Journal Checker Chatbot试用版本，并将其作为一种替代聊天机器人进行讨论，该聊天机器人可以帮助研究人员检测被劫持的期刊。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Diagnosis Reliability of ChatGPT for Journal Evaluation

Purpose: Academic and other researchers have limited tools with which to address the current proliferation of predatory and hijacked journals. These journals can have negative effects on science, research funding, and the dissemination of information. As most predatory and hijacked journals are not error free, this study used ChatGPT, an artificial intelligence technology tool, to conduct an evaluation of journal quality. Methods: Predatory and hijacked journals were analyzed for reliability using ChatGPT, and the reliability of result have been discussed. Results: It shows that ChatGPT is an unreliable tool for journal quality evaluation for both hijacked and predatory journals. Conclusion: To show how address this gap, an early trial version of Journal Checker Chatbot has been developed and is discussed as an alternative chatbot that can assist researchers in detecting hijacked journals.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Advanced pharmaceutical bulletin PHARMACOLOGY & PHARMACY-

CiteScore

6.80

自引率

2.80%

发文量

审稿时长

12 weeks