Wang Jinghong , Yang Hongbo , Wang Xizhao , Wang Wei , Li Yanan
{"title":"MAGNet:一种用于早期错误信息检测的多模态知识增强图网络","authors":"Wang Jinghong , Yang Hongbo , Wang Xizhao , Wang Wei , Li Yanan","doi":"10.1016/j.neucom.2025.131533","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid proliferation of multimodal misinformation on social media, detecting such content has become increasingly challenging. Existing approaches often rely on flat or shallow fusion strategies, which fail to capture structured semantic interactions across modalities. Moreover, most methods lack controllable, task-relevant mechanisms for integrating external knowledge, limiting their adaptability to emerging misinformation. In this paper, we present MAGNet, a Multimodal Augmented Graph Network that models fine-grained features with LLM-enhanced contextual knowledge through a hierarchical graph attention framework. MAGNet constructs heterogeneous graphs with modality- and context-specific edge weights based on semantic and affective alignment, enabling progressive reasoning from local features to global representations. Extensive experiments on three real-world datasets demonstrate that MAGNet consistently outperforms strong baselines across multiple evaluation metrics. The results underscore the effectiveness of combining graph-based modeling, fine-grained fusion, and structured knowledge integration in developing scalable and robust solutions for multimodal misinformation detection.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"658 ","pages":"Article 131533"},"PeriodicalIF":6.5000,"publicationDate":"2025-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MAGNet: A multimodal knowledge-augmented graph network for early-stage misinformation detection\",\"authors\":\"Wang Jinghong , Yang Hongbo , Wang Xizhao , Wang Wei , Li Yanan\",\"doi\":\"10.1016/j.neucom.2025.131533\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>With the rapid proliferation of multimodal misinformation on social media, detecting such content has become increasingly challenging. Existing approaches often rely on flat or shallow fusion strategies, which fail to capture structured semantic interactions across modalities. Moreover, most methods lack controllable, task-relevant mechanisms for integrating external knowledge, limiting their adaptability to emerging misinformation. In this paper, we present MAGNet, a Multimodal Augmented Graph Network that models fine-grained features with LLM-enhanced contextual knowledge through a hierarchical graph attention framework. MAGNet constructs heterogeneous graphs with modality- and context-specific edge weights based on semantic and affective alignment, enabling progressive reasoning from local features to global representations. Extensive experiments on three real-world datasets demonstrate that MAGNet consistently outperforms strong baselines across multiple evaluation metrics. The results underscore the effectiveness of combining graph-based modeling, fine-grained fusion, and structured knowledge integration in developing scalable and robust solutions for multimodal misinformation detection.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"658 \",\"pages\":\"Article 131533\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-09-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231225022052\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225022052","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
MAGNet: A multimodal knowledge-augmented graph network for early-stage misinformation detection
With the rapid proliferation of multimodal misinformation on social media, detecting such content has become increasingly challenging. Existing approaches often rely on flat or shallow fusion strategies, which fail to capture structured semantic interactions across modalities. Moreover, most methods lack controllable, task-relevant mechanisms for integrating external knowledge, limiting their adaptability to emerging misinformation. In this paper, we present MAGNet, a Multimodal Augmented Graph Network that models fine-grained features with LLM-enhanced contextual knowledge through a hierarchical graph attention framework. MAGNet constructs heterogeneous graphs with modality- and context-specific edge weights based on semantic and affective alignment, enabling progressive reasoning from local features to global representations. Extensive experiments on three real-world datasets demonstrate that MAGNet consistently outperforms strong baselines across multiple evaluation metrics. The results underscore the effectiveness of combining graph-based modeling, fine-grained fusion, and structured knowledge integration in developing scalable and robust solutions for multimodal misinformation detection.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.