评估 ChatGPT 作为搜索野生哺乳动物信息的创新工具的潜力

IF 5.8 2区 环境科学与生态学 Q1 ECOLOGY
Jenner Rodas-Trejo , Paola Ocampo-González
{"title":"评估 ChatGPT 作为搜索野生哺乳动物信息的创新工具的潜力","authors":"Jenner Rodas-Trejo ,&nbsp;Paola Ocampo-González","doi":"10.1016/j.ecoinf.2024.102810","DOIUrl":null,"url":null,"abstract":"<div><p>In November 2022 OpenAI launched ChatGPT, an Artificial Intelligence model capable of processing, retrieving, and organizing large amounts of data and identifying patterns, thereby generating text on various topics and contexts. In recent months ChatGPT has gained wide attention and adoption in the academic and scientific fields, so its use is being widely evaluated and discussed. In this connection, an evaluation of the performance of ChatGPT was carried out on the accuracy of the answers on general knowledge about wild mammals and the specific knowledge of 30 species. A descriptive study was carried out using three chats where twenty-one questions on general knowledge and three questions on specific knowledge were asked. The questions considered information on the taxonomy, natural history, and conservation status of each species, as well as concepts and indices commonly used in the study of wild mammals. The answers were compared with scientific literature and a value was assigned to later obtain the percentage of precision. The results showed a high precision in the specific knowledge of the species, with an average of 88 % correct answers. Precision varied by species, with species scoring close to 100 % and others scoring as low as 65 %. The taxonomy question had 100 % correct answers, the natural history questions 90 %, and the conservation status question 56 %. In the precision of the general knowledge answers in the study of wild mammals, a moderate precision of 73.54 % was obtained. The study shows that ChatGPT has high precision, so it can be a helpful tool in the search for information in research on wild mammals. On the other hand, concerns are raised about its applicability in the academic field, due to the risk of producing unreliable or biased results and generating inaccurate or misleading content, so it is important to take into account the limitations and risks associated with its use. It is suggested that further research and insight into accuracy be done to explore the full potential of ChatGPT.</p></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":null,"pages":null},"PeriodicalIF":5.8000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1574954124003522/pdfft?md5=d5025382c641c9f60b6256f7ed5d09b2&pid=1-s2.0-S1574954124003522-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Assessment of ChatGPT's potential as an innovative tool in searching for information on wild mammals\",\"authors\":\"Jenner Rodas-Trejo ,&nbsp;Paola Ocampo-González\",\"doi\":\"10.1016/j.ecoinf.2024.102810\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In November 2022 OpenAI launched ChatGPT, an Artificial Intelligence model capable of processing, retrieving, and organizing large amounts of data and identifying patterns, thereby generating text on various topics and contexts. In recent months ChatGPT has gained wide attention and adoption in the academic and scientific fields, so its use is being widely evaluated and discussed. In this connection, an evaluation of the performance of ChatGPT was carried out on the accuracy of the answers on general knowledge about wild mammals and the specific knowledge of 30 species. A descriptive study was carried out using three chats where twenty-one questions on general knowledge and three questions on specific knowledge were asked. The questions considered information on the taxonomy, natural history, and conservation status of each species, as well as concepts and indices commonly used in the study of wild mammals. The answers were compared with scientific literature and a value was assigned to later obtain the percentage of precision. The results showed a high precision in the specific knowledge of the species, with an average of 88 % correct answers. Precision varied by species, with species scoring close to 100 % and others scoring as low as 65 %. The taxonomy question had 100 % correct answers, the natural history questions 90 %, and the conservation status question 56 %. In the precision of the general knowledge answers in the study of wild mammals, a moderate precision of 73.54 % was obtained. The study shows that ChatGPT has high precision, so it can be a helpful tool in the search for information in research on wild mammals. On the other hand, concerns are raised about its applicability in the academic field, due to the risk of producing unreliable or biased results and generating inaccurate or misleading content, so it is important to take into account the limitations and risks associated with its use. It is suggested that further research and insight into accuracy be done to explore the full potential of ChatGPT.</p></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2024-09-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1574954124003522/pdfft?md5=d5025382c641c9f60b6256f7ed5d09b2&pid=1-s2.0-S1574954124003522-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954124003522\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124003522","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

2022 年 11 月,OpenAI 推出了人工智能模型 ChatGPT,该模型能够处理、检索和组织大量数据并识别模式,从而生成各种主题和语境的文本。近几个月来,ChatGPT 在学术和科学领域获得了广泛的关注和采用,因此其使用情况也得到了广泛的评估和讨论。为此,我们对 ChatGPT 的性能进行了评估,内容涉及野生哺乳动物常识答案的准确性和 30 个物种的具体知识。我们使用三个聊天工具进行了描述性研究,共提出了 21 个关于常识的问题和 3 个关于具体知识的问题。这些问题涉及每个物种的分类、自然历史和保护状况,以及野生哺乳动物研究中常用的概念和指数。将答案与科学文献进行比较,然后赋值,得出精确度百分比。结果表明,对物种具体知识的准确度很高,平均正确率为 88%。准确率因物种而异,有些物种接近 100%,有些则低至 65%。分类学问题的正确率为 100%,自然史问题为 90%,保护状况问题为 56%。在野生哺乳动物研究中,常识答案的精确度为 73.54%,属于中等水平。研究结果表明,ChatGPT 具有较高的精确度,因此可以成为研究野生哺乳动物时搜索信息的有用工具。另一方面,人们对其在学术领域的适用性表示担忧,因为它有可能产生不可靠或有偏见的结果,产生不准确或误导性的内容,因此必须考虑到其使用的局限性和风险。建议进一步研究和深入了解其准确性,以充分挖掘 ChatGPT 的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Assessment of ChatGPT's potential as an innovative tool in searching for information on wild mammals

In November 2022 OpenAI launched ChatGPT, an Artificial Intelligence model capable of processing, retrieving, and organizing large amounts of data and identifying patterns, thereby generating text on various topics and contexts. In recent months ChatGPT has gained wide attention and adoption in the academic and scientific fields, so its use is being widely evaluated and discussed. In this connection, an evaluation of the performance of ChatGPT was carried out on the accuracy of the answers on general knowledge about wild mammals and the specific knowledge of 30 species. A descriptive study was carried out using three chats where twenty-one questions on general knowledge and three questions on specific knowledge were asked. The questions considered information on the taxonomy, natural history, and conservation status of each species, as well as concepts and indices commonly used in the study of wild mammals. The answers were compared with scientific literature and a value was assigned to later obtain the percentage of precision. The results showed a high precision in the specific knowledge of the species, with an average of 88 % correct answers. Precision varied by species, with species scoring close to 100 % and others scoring as low as 65 %. The taxonomy question had 100 % correct answers, the natural history questions 90 %, and the conservation status question 56 %. In the precision of the general knowledge answers in the study of wild mammals, a moderate precision of 73.54 % was obtained. The study shows that ChatGPT has high precision, so it can be a helpful tool in the search for information in research on wild mammals. On the other hand, concerns are raised about its applicability in the academic field, due to the risk of producing unreliable or biased results and generating inaccurate or misleading content, so it is important to take into account the limitations and risks associated with its use. It is suggested that further research and insight into accuracy be done to explore the full potential of ChatGPT.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Ecological Informatics
Ecological Informatics 环境科学-生态学
CiteScore
8.30
自引率
11.80%
发文量
346
审稿时长
46 days
期刊介绍: The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change. The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信