BotDMM: Dual-channel multi-modal learning for LLM-driven bot detection on social media

IF 15.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Jinglong Duan , Shiqing Wu , Weihua Li , Quan Bai , Minh Nguyen , Jianhua Jiang
{"title":"BotDMM: Dual-channel multi-modal learning for LLM-driven bot detection on social media","authors":"Jinglong Duan ,&nbsp;Shiqing Wu ,&nbsp;Weihua Li ,&nbsp;Quan Bai ,&nbsp;Minh Nguyen ,&nbsp;Jianhua Jiang","doi":"10.1016/j.inffus.2025.103758","DOIUrl":null,"url":null,"abstract":"<div><div>Social bots are becoming a growing concern due to their ability to spread misinformation and manipulate public discourse. The emergence of powerful Large Language Models (LLMs), such as ChatGPT, has introduced a new generation of bots capable of producing fluent and human-like text while dynamically adapting their relational patterns over time. These LLM-driven bots seamlessly blend into online communities, making them significantly more challenging to detect. Most existing approaches rely on static features or simple behavioral patterns, which are not effective against bots that can evolve both their language and their network connections. To address these challenges, we propose a novel Dual-channel Multi-Modal learning (BotDMM) framework for LLM-driven bot detection. The proposed model captures discriminative information from two complementary sources: users’ content features (including their profiles and temporal posting behavior) and structural features (reflecting local network topology). Furthermore, we employ a joint training approach that incorporates two carefully designed self-supervised learning paradigms alongside the primary prediction task to enhance discrimination between human users, traditional bots, and LLM-driven bots. Extensive experiments demonstrate the effectiveness and superiority of BotDMM compared to state-of-the-art baselines. The implementation of BotDMM has been released at: <span><span>https://github.com/JaydenDuan/DualChannelBotDMM</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50367,"journal":{"name":"Information Fusion","volume":"127 ","pages":"Article 103758"},"PeriodicalIF":15.5000,"publicationDate":"2025-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Fusion","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1566253525008206","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Social bots are becoming a growing concern due to their ability to spread misinformation and manipulate public discourse. The emergence of powerful Large Language Models (LLMs), such as ChatGPT, has introduced a new generation of bots capable of producing fluent and human-like text while dynamically adapting their relational patterns over time. These LLM-driven bots seamlessly blend into online communities, making them significantly more challenging to detect. Most existing approaches rely on static features or simple behavioral patterns, which are not effective against bots that can evolve both their language and their network connections. To address these challenges, we propose a novel Dual-channel Multi-Modal learning (BotDMM) framework for LLM-driven bot detection. The proposed model captures discriminative information from two complementary sources: users’ content features (including their profiles and temporal posting behavior) and structural features (reflecting local network topology). Furthermore, we employ a joint training approach that incorporates two carefully designed self-supervised learning paradigms alongside the primary prediction task to enhance discrimination between human users, traditional bots, and LLM-driven bots. Extensive experiments demonstrate the effectiveness and superiority of BotDMM compared to state-of-the-art baselines. The implementation of BotDMM has been released at: https://github.com/JaydenDuan/DualChannelBotDMM.
BotDMM:社交媒体上llm驱动的机器人检测的双通道多模态学习
由于社交机器人传播错误信息和操纵公共话语的能力,它们正日益受到关注。强大的大型语言模型(llm)的出现,如ChatGPT,引入了新一代的机器人,它们能够产生流畅的、类似人类的文本,同时随着时间的推移动态地调整它们的关系模式。这些llm驱动的机器人无缝地融入在线社区,使它们更具有挑战性。大多数现有的方法依赖于静态特征或简单的行为模式,这对可以进化语言和网络连接的机器人是无效的。为了解决这些挑战,我们提出了一种新的双通道多模态学习(BotDMM)框架,用于llm驱动的机器人检测。提出的模型从两个互补的来源捕获判别信息:用户的内容特征(包括他们的个人资料和时间发布行为)和结构特征(反映本地网络拓扑结构)。此外,我们采用了一种联合训练方法,该方法结合了两种精心设计的自我监督学习范式以及主要预测任务,以增强人类用户,传统机器人和llm驱动机器人之间的区别。大量的实验证明了与最先进的基线相比,BotDMM的有效性和优越性。BotDMM的实现已经发布在:https://github.com/JaydenDuan/DualChannelBotDMM。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Information Fusion
Information Fusion 工程技术-计算机:理论方法
CiteScore
33.20
自引率
4.30%
发文量
161
审稿时长
7.9 months
期刊介绍: Information Fusion serves as a central platform for showcasing advancements in multi-sensor, multi-source, multi-process information fusion, fostering collaboration among diverse disciplines driving its progress. It is the leading outlet for sharing research and development in this field, focusing on architectures, algorithms, and applications. Papers dealing with fundamental theoretical analyses as well as those demonstrating their application to real-world problems will be welcome.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信