Task-Aware Multimodal Large Language Models for Distributed Acoustic Sensing–Based Seismic Monitoring

IF 9.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
IEEE Transactions on Multimedia Pub Date : 2026-01-01 Epub Date: 2026-06-22 DOI:10.1109/TMM.2026.3705143
Honglin Guo;Zimeng Zhao;Chao Li;Yuting Su;Huayong Yang;Weizhi Nie
{"title":"Task-Aware Multimodal Large Language Models for Distributed Acoustic Sensing–Based Seismic Monitoring","authors":"Honglin Guo;Zimeng Zhao;Chao Li;Yuting Su;Huayong Yang;Weizhi Nie","doi":"10.1109/TMM.2026.3705143","DOIUrl":null,"url":null,"abstract":"Seismic monitoring detects earthquake activity to investigate fundamental geophysical processes, advance understanding of earthquake mechanisms, and support hazard mitigation. Distributed acoustic sensing (DAS) uses existing fiber-optic cables to provide dense, long-range, high-resolution measurements over wide areas at low cost, showing strong potential for seismic monitoring. However, manually labeled DAS data are scarce and large annotated datasets are hard to obtain, which limits supervised deep-learning methods. In this paper, we present DAS-MLLM, a training-free framework that leverages multimodal large language models (MLLMs) for seismic monitoring. DAS-MLLM comprises three components: (1) a task-aware Visual Generator that adaptively selects informative spectro-temporal visualizations of DAS signals; (2) a composite-similarity Retriever that uses time- and frequency-domain features to retrieve relevant exemplars for in-context learning; and (3) a feedback-guided Self-Corrector that integrates unselected visualizations to refine predictions. We evaluate DAS-MLLM on the Ridgecrest dataset and on the Xinfengjiang DAS dataset from Guangdong, China (558 events, with a high proportion of microearthquakes); the latter also includes seismometer recordings for some of the same events, enabling direct comparison with seismometer-based methods. Results show that our method improves most metrics in earthquake detection, magnitude estimation, and hypocenter localization tasks. DAS-MLLM reduces localization error by up to 28.8% and improves detection F1-score by 19.4% compared with state-of-the-art methods.","PeriodicalId":13273,"journal":{"name":"IEEE Transactions on Multimedia","volume":"28 ","pages":"10786-10797"},"PeriodicalIF":9.9000,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Multimedia","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11573986/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/22 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Seismic monitoring detects earthquake activity to investigate fundamental geophysical processes, advance understanding of earthquake mechanisms, and support hazard mitigation. Distributed acoustic sensing (DAS) uses existing fiber-optic cables to provide dense, long-range, high-resolution measurements over wide areas at low cost, showing strong potential for seismic monitoring. However, manually labeled DAS data are scarce and large annotated datasets are hard to obtain, which limits supervised deep-learning methods. In this paper, we present DAS-MLLM, a training-free framework that leverages multimodal large language models (MLLMs) for seismic monitoring. DAS-MLLM comprises three components: (1) a task-aware Visual Generator that adaptively selects informative spectro-temporal visualizations of DAS signals; (2) a composite-similarity Retriever that uses time- and frequency-domain features to retrieve relevant exemplars for in-context learning; and (3) a feedback-guided Self-Corrector that integrates unselected visualizations to refine predictions. We evaluate DAS-MLLM on the Ridgecrest dataset and on the Xinfengjiang DAS dataset from Guangdong, China (558 events, with a high proportion of microearthquakes); the latter also includes seismometer recordings for some of the same events, enabling direct comparison with seismometer-based methods. Results show that our method improves most metrics in earthquake detection, magnitude estimation, and hypocenter localization tasks. DAS-MLLM reduces localization error by up to 28.8% and improves detection F1-score by 19.4% compared with state-of-the-art methods.
分布式声传感地震监测的任务感知多模态大语言模型
地震监测检测地震活动,以调查基本的地球物理过程,促进对地震机制的理解,并支持减灾。分布式声传感(DAS)利用现有的光纤电缆,以低成本在大范围内提供密集、远程、高分辨率的测量,显示出强大的地震监测潜力。然而,人工标记的DAS数据很少,而且很难获得大型注释数据集,这限制了监督深度学习方法。在本文中,我们提出了DAS-MLLM,这是一个利用多模态大语言模型(mllm)进行地震监测的无需训练的框架。DAS- mlm由三个部分组成:(1)一个任务感知的视觉生成器,它自适应地选择DAS信号的信息光谱-时间可视化;(2)利用时域和频域特征检索相关样本进行语境学习的复合相似检索器;(3)一个反馈引导的自我校正器,它集成了未选择的可视化来改进预测。我们在Ridgecrest数据集和中国广东新丰江DAS数据集(558个事件,微震比例较高)上对DAS- mlm进行了评价;后者还包括地震仪对一些相同事件的记录,从而可以与基于地震仪的方法进行直接比较。结果表明,我们的方法改进了地震探测、震级估计和震源定位任务中的大多数指标。与现有方法相比,das - mlm将定位误差降低了28.8%,将检测f1分数提高了19.4%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Multimedia
IEEE Transactions on Multimedia 工程技术-电信学
CiteScore
11.70
自引率
11.00%
发文量
576
审稿时长
5.5 months
期刊介绍: The IEEE Transactions on Multimedia delves into diverse aspects of multimedia technology and applications, covering circuits, networking, signal processing, systems, software, and systems integration. The scope aligns with the Fields of Interest of the sponsors, ensuring a comprehensive exploration of research in multimedia.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书