Uncertainty-aware disentangled representation learning for multimodal fake news detection

IF 7.4 1区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Zihao Li , Jiaxin Yang , Xianghan Wang, Jun Lei, Shuohao Li, Jun Zhang
{"title":"Uncertainty-aware disentangled representation learning for multimodal fake news detection","authors":"Zihao Li ,&nbsp;Jiaxin Yang ,&nbsp;Xianghan Wang,&nbsp;Jun Lei,&nbsp;Shuohao Li,&nbsp;Jun Zhang","doi":"10.1016/j.ipm.2025.104190","DOIUrl":null,"url":null,"abstract":"<div><div>The proliferation of fake news on social media platforms poses serious societal risks, such as eroding public trust, inciting panic, and influencing policy decisions. While automated multimodal fake news detection has emerged as a promising approach, existing methods face three critical limitations: (1) they often fail to capture uncertainty within multimodal data, (2) they struggle with modality heterogeneity, and (3) they lack a balanced focus on both modality-private veracity and cross-modal inconsistencies. In this work, we propose a novel <strong>U</strong>ncertainty-aware <strong>D</strong>isentangled <strong>R</strong>epresentation <strong>L</strong>earning (UDRL) framework that addresses these limitations in three key ways. First, our probabilistic representation module models multimodal information as Gaussian distributions, effectively capturing uncertainty and ambiguity. Second, we introduce a disentangled representation learning framework that separates shared and private modality information, enhancing robustness and discrimination. Finally, our uncertainty-aware fusion module dynamically adjusts modality importance based on uncertainty, facilitating more accurate cross-modal interactions. Experimental results on three benchmark datasets demonstrate that UDRL achieves competitive and consistent performance across datasets, validating its effectiveness in multimodal fake news detection.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"62 5","pages":"Article 104190"},"PeriodicalIF":7.4000,"publicationDate":"2025-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457325001311","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

The proliferation of fake news on social media platforms poses serious societal risks, such as eroding public trust, inciting panic, and influencing policy decisions. While automated multimodal fake news detection has emerged as a promising approach, existing methods face three critical limitations: (1) they often fail to capture uncertainty within multimodal data, (2) they struggle with modality heterogeneity, and (3) they lack a balanced focus on both modality-private veracity and cross-modal inconsistencies. In this work, we propose a novel Uncertainty-aware Disentangled Representation Learning (UDRL) framework that addresses these limitations in three key ways. First, our probabilistic representation module models multimodal information as Gaussian distributions, effectively capturing uncertainty and ambiguity. Second, we introduce a disentangled representation learning framework that separates shared and private modality information, enhancing robustness and discrimination. Finally, our uncertainty-aware fusion module dynamically adjusts modality importance based on uncertainty, facilitating more accurate cross-modal interactions. Experimental results on three benchmark datasets demonstrate that UDRL achieves competitive and consistent performance across datasets, validating its effectiveness in multimodal fake news detection.
多模态假新闻检测的不确定性感知解纠缠表征学习
假新闻在社交媒体平台上的泛滥造成了严重的社会风险,如侵蚀公众信任、煽动恐慌、影响政策决策等。虽然自动化多模态假新闻检测已经成为一种很有前途的方法,但现有方法面临三个关键限制:(1)它们通常无法捕获多模态数据中的不确定性;(2)它们难以处理模态异质性;(3)它们缺乏对模态私有真实性和跨模态不一致性的平衡关注。在这项工作中,我们提出了一种新的不确定性感知解纠缠表征学习(UDRL)框架,该框架从三个关键方面解决了这些限制。首先,我们的概率表示模块将多模态信息建模为高斯分布,有效捕获不确定性和模糊性。其次,我们引入了一个分离共享和私有模态信息的解纠缠表示学习框架,增强了鲁棒性和识别能力。最后,我们的不确定性感知融合模块基于不确定性动态调整模态重要性,促进更准确的跨模态交互。在三个基准数据集上的实验结果表明,UDRL在多个数据集上实现了竞争和一致的性能,验证了其在多模态假新闻检测中的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Information Processing & Management
Information Processing & Management 工程技术-计算机:信息系统
CiteScore
17.00
自引率
11.60%
发文量
276
审稿时长
39 days
期刊介绍: Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing. We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信