生成性人工智能介导的健康信息寻求中的确认偏误

IF 4.8 3区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES
Ezequiel Lopez-Lopez, Christoph M. Abels, Dawn Holford, Stefan M. Herzog, Stephan Lewandowsky
{"title":"生成性人工智能介导的健康信息寻求中的确认偏误","authors":"Ezequiel Lopez-Lopez,&nbsp;Christoph M. Abels,&nbsp;Dawn Holford,&nbsp;Stefan M. Herzog,&nbsp;Stephan Lewandowsky","doi":"10.1111/nyas.15413","DOIUrl":null,"url":null,"abstract":"<p>Generative artificial intelligence (GenAI) applications, such as ChatGPT, are transforming how individuals access health information, offering conversational and highly personalized interactions. While these technologies can enhance health literacy and decision-making, their capacity to generate deeply tailored—<i>hypercustomized</i>—responses risks amplifying confirmation bias by reinforcing pre-existing beliefs, obscuring medical consensus, and perpetuating misinformation, posing significant challenges to public health. This paper examines GenAI-mediated confirmation bias in health information seeking, driven by the interplay between GenAI's hypercustomization capabilities and users’ confirmatory tendencies. Drawing on parallels with traditional online information-seeking behaviors, we identify three key “pressure points” where biases might emerge: query phrasing, preference for belief-consistent content, and resistance to belief-inconsistent information. Using illustrative examples, we highlight the limitations of existing safeguards and argue that even minor variations in applications’ configuration (e.g., Custom GPT) can exacerbate these biases along those pressure points. Given the widespread adoption and fragmentation (e.g., OpenAI's GPT Store) of GenAI applications, their influence on health-seeking behaviors demands urgent attention. Since technical safeguards alone may be insufficient, we propose a set of interventions, including enhancing digital literacy, empowering users with critical engagement strategies, and implementing robust regulatory oversight. These recommendations aim to ensure the safe integration of GenAI into daily life, supporting informed decision-making and preserving the integrity of public understanding of health information.</p>","PeriodicalId":8250,"journal":{"name":"Annals of the New York Academy of Sciences","volume":"1550 1","pages":"23-36"},"PeriodicalIF":4.8000,"publicationDate":"2025-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://nyaspubs.onlinelibrary.wiley.com/doi/epdf/10.1111/nyas.15413","citationCount":"0","resultStr":"{\"title\":\"Generative artificial intelligence–mediated confirmation bias in health information seeking\",\"authors\":\"Ezequiel Lopez-Lopez,&nbsp;Christoph M. Abels,&nbsp;Dawn Holford,&nbsp;Stefan M. Herzog,&nbsp;Stephan Lewandowsky\",\"doi\":\"10.1111/nyas.15413\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Generative artificial intelligence (GenAI) applications, such as ChatGPT, are transforming how individuals access health information, offering conversational and highly personalized interactions. While these technologies can enhance health literacy and decision-making, their capacity to generate deeply tailored—<i>hypercustomized</i>—responses risks amplifying confirmation bias by reinforcing pre-existing beliefs, obscuring medical consensus, and perpetuating misinformation, posing significant challenges to public health. This paper examines GenAI-mediated confirmation bias in health information seeking, driven by the interplay between GenAI's hypercustomization capabilities and users’ confirmatory tendencies. Drawing on parallels with traditional online information-seeking behaviors, we identify three key “pressure points” where biases might emerge: query phrasing, preference for belief-consistent content, and resistance to belief-inconsistent information. Using illustrative examples, we highlight the limitations of existing safeguards and argue that even minor variations in applications’ configuration (e.g., Custom GPT) can exacerbate these biases along those pressure points. Given the widespread adoption and fragmentation (e.g., OpenAI's GPT Store) of GenAI applications, their influence on health-seeking behaviors demands urgent attention. Since technical safeguards alone may be insufficient, we propose a set of interventions, including enhancing digital literacy, empowering users with critical engagement strategies, and implementing robust regulatory oversight. These recommendations aim to ensure the safe integration of GenAI into daily life, supporting informed decision-making and preserving the integrity of public understanding of health information.</p>\",\"PeriodicalId\":8250,\"journal\":{\"name\":\"Annals of the New York Academy of Sciences\",\"volume\":\"1550 1\",\"pages\":\"23-36\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2025-07-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://nyaspubs.onlinelibrary.wiley.com/doi/epdf/10.1111/nyas.15413\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Annals of the New York Academy of Sciences\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://nyaspubs.onlinelibrary.wiley.com/doi/10.1111/nyas.15413\",\"RegionNum\":3,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of the New York Academy of Sciences","FirstCategoryId":"103","ListUrlMain":"https://nyaspubs.onlinelibrary.wiley.com/doi/10.1111/nyas.15413","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

ChatGPT等生成式人工智能(GenAI)应用程序正在改变个人访问健康信息的方式,提供对话式和高度个性化的交互。虽然这些技术可以提高卫生素养和决策能力,但它们产生高度定制的应对措施的能力可能会强化已有的信念,模糊医学共识,并使错误信息永久化,从而放大确认偏差,对公共卫生构成重大挑战。本文研究了在GenAI的超定制能力和用户确认倾向之间的相互作用下,GenAI介导的健康信息寻求中的确认偏差。根据与传统在线信息搜索行为的相似之处,我们确定了可能出现偏差的三个关键“压力点”:查询措辞、对信念一致的内容的偏好以及对信念不一致的信息的抵制。使用说明性的例子,我们强调了现有保护措施的局限性,并论证了即使是应用程序配置中的微小变化(例如,Custom GPT)也会沿着这些压力点加剧这些偏差。鉴于GenAI应用程序的广泛采用和碎片化(例如OpenAI的GPT Store),它们对寻求健康行为的影响需要迫切关注。由于仅靠技术保障措施可能不够,我们提出了一系列干预措施,包括提高数字素养,通过关键的参与战略赋予用户权力,以及实施强有力的监管监督。这些建议旨在确保基因信息安全融入日常生活,支持知情决策并保持公众对卫生信息理解的完整性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Generative artificial intelligence–mediated confirmation bias in health information seeking

Generative artificial intelligence–mediated confirmation bias in health information seeking

Generative artificial intelligence–mediated confirmation bias in health information seeking

Generative artificial intelligence–mediated confirmation bias in health information seeking

Generative artificial intelligence–mediated confirmation bias in health information seeking

Generative artificial intelligence (GenAI) applications, such as ChatGPT, are transforming how individuals access health information, offering conversational and highly personalized interactions. While these technologies can enhance health literacy and decision-making, their capacity to generate deeply tailored—hypercustomized—responses risks amplifying confirmation bias by reinforcing pre-existing beliefs, obscuring medical consensus, and perpetuating misinformation, posing significant challenges to public health. This paper examines GenAI-mediated confirmation bias in health information seeking, driven by the interplay between GenAI's hypercustomization capabilities and users’ confirmatory tendencies. Drawing on parallels with traditional online information-seeking behaviors, we identify three key “pressure points” where biases might emerge: query phrasing, preference for belief-consistent content, and resistance to belief-inconsistent information. Using illustrative examples, we highlight the limitations of existing safeguards and argue that even minor variations in applications’ configuration (e.g., Custom GPT) can exacerbate these biases along those pressure points. Given the widespread adoption and fragmentation (e.g., OpenAI's GPT Store) of GenAI applications, their influence on health-seeking behaviors demands urgent attention. Since technical safeguards alone may be insufficient, we propose a set of interventions, including enhancing digital literacy, empowering users with critical engagement strategies, and implementing robust regulatory oversight. These recommendations aim to ensure the safe integration of GenAI into daily life, supporting informed decision-making and preserving the integrity of public understanding of health information.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Annals of the New York Academy of Sciences
Annals of the New York Academy of Sciences 综合性期刊-综合性期刊
CiteScore
11.00
自引率
1.90%
发文量
193
审稿时长
2-4 weeks
期刊介绍: Published on behalf of the New York Academy of Sciences, Annals of the New York Academy of Sciences provides multidisciplinary perspectives on research of current scientific interest with far-reaching implications for the wider scientific community and society at large. Each special issue assembles the best thinking of key contributors to a field of investigation at a time when emerging developments offer the promise of new insight. Individually themed, Annals special issues stimulate new ways to think about science by providing a neutral forum for discourse—within and across many institutions and fields.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信