Sophia Charlotte Volk, Mike S Schäfer, Damiano Lombardi, Daniela Mahl, Xiaoyue Yan
{"title":"生成式人工智能如何描绘科学:从不同受众群体的角度采访 ChatGPT。","authors":"Sophia Charlotte Volk, Mike S Schäfer, Damiano Lombardi, Daniela Mahl, Xiaoyue Yan","doi":"10.1177/09636625241268910","DOIUrl":null,"url":null,"abstract":"<p><p>Generative artificial intelligence in general and ChatGPT in particular have risen in importance. ChatGPT is widely known and used increasingly as an information source for different topics, including science. It is therefore relevant to examine how ChatGPT portrays science and science-related issues. Research on this question is lacking, however. Hence, we simulate \"interviews\" with ChatGPT and reconstruct how it presents science, science communication, scientific misbehavior, and controversial scientific issues. Combining qualitative and quantitative content analysis, we find that, generally, ChatGPT portrays science largely as the STEM disciplines, in a positivist-empiricist way and a positive light. When comparing ChatGPT's responses to different simulated user profiles and responses from the GPT-3.5 and GPT-4 versions, we find similarities in that the scientific consensus on questions such as climate change, COVID-19 vaccinations, or astrology is consistently conveyed across them. Beyond these similarities in substance, however, pronounced differences are found in the personalization of responses to different user profiles and between GPT-3.5 and GPT-4.</p>","PeriodicalId":48094,"journal":{"name":"Public Understanding of Science","volume":" ","pages":"9636625241268910"},"PeriodicalIF":3.5000,"publicationDate":"2024-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"How generative artificial intelligence portrays science: Interviewing ChatGPT from the perspective of different audience segments.\",\"authors\":\"Sophia Charlotte Volk, Mike S Schäfer, Damiano Lombardi, Daniela Mahl, Xiaoyue Yan\",\"doi\":\"10.1177/09636625241268910\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Generative artificial intelligence in general and ChatGPT in particular have risen in importance. ChatGPT is widely known and used increasingly as an information source for different topics, including science. It is therefore relevant to examine how ChatGPT portrays science and science-related issues. Research on this question is lacking, however. Hence, we simulate \\\"interviews\\\" with ChatGPT and reconstruct how it presents science, science communication, scientific misbehavior, and controversial scientific issues. Combining qualitative and quantitative content analysis, we find that, generally, ChatGPT portrays science largely as the STEM disciplines, in a positivist-empiricist way and a positive light. When comparing ChatGPT's responses to different simulated user profiles and responses from the GPT-3.5 and GPT-4 versions, we find similarities in that the scientific consensus on questions such as climate change, COVID-19 vaccinations, or astrology is consistently conveyed across them. Beyond these similarities in substance, however, pronounced differences are found in the personalization of responses to different user profiles and between GPT-3.5 and GPT-4.</p>\",\"PeriodicalId\":48094,\"journal\":{\"name\":\"Public Understanding of Science\",\"volume\":\" \",\"pages\":\"9636625241268910\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-09-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Public Understanding of Science\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://doi.org/10.1177/09636625241268910\",\"RegionNum\":2,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMMUNICATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Public Understanding of Science","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1177/09636625241268910","RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMMUNICATION","Score":null,"Total":0}
How generative artificial intelligence portrays science: Interviewing ChatGPT from the perspective of different audience segments.
Generative artificial intelligence in general and ChatGPT in particular have risen in importance. ChatGPT is widely known and used increasingly as an information source for different topics, including science. It is therefore relevant to examine how ChatGPT portrays science and science-related issues. Research on this question is lacking, however. Hence, we simulate "interviews" with ChatGPT and reconstruct how it presents science, science communication, scientific misbehavior, and controversial scientific issues. Combining qualitative and quantitative content analysis, we find that, generally, ChatGPT portrays science largely as the STEM disciplines, in a positivist-empiricist way and a positive light. When comparing ChatGPT's responses to different simulated user profiles and responses from the GPT-3.5 and GPT-4 versions, we find similarities in that the scientific consensus on questions such as climate change, COVID-19 vaccinations, or astrology is consistently conveyed across them. Beyond these similarities in substance, however, pronounced differences are found in the personalization of responses to different user profiles and between GPT-3.5 and GPT-4.
期刊介绍:
Public Understanding of Science is a fully peer reviewed international journal covering all aspects of the inter-relationships between science (including technology and medicine) and the public. Public Understanding of Science is the only journal to cover all aspects of the inter-relationships between science (including technology and medicine) and the public. Topics Covered Include... ·surveys of public understanding and attitudes towards science and technology ·perceptions of science ·popular representations of science ·scientific and para-scientific belief systems ·science in schools