{"title":"基于AAE-CycleWGAN融合框架的桥梁监测系统中稀疏域到密集域的应变融合数据生成","authors":"Sahar Hassani , Ulrike Dackermann , Mohsen Mousavi , Samir Mustapha , Jianchun Li","doi":"10.1016/j.inffus.2025.103736","DOIUrl":null,"url":null,"abstract":"<div><div>Effective monitoring of pedestrian bridges is challenged by noisy measurements, missing data, and time-varying crowd excitation–critical issues for infrastructure and crowd management where timely safety monitoring is paramount. In this work, we quantify human–structure interaction to enable a monitoring system that detects abnormal loads and supports bridge safety management. We also model structural responses under dense-occupancy conditions to predict behavior in busy scenarios, providing decision-ready insights that reduce the risk of serviceability loss. We propose a fusion-centred framework that (i) derives informative, noise-robust features from raw noisy structural strain responses via an optimized adversarial autoencoder (AAE) for denoising and dimensionality reduction, (ii) mitigates data scarcity by synthesizing missing fused modalities using a Cycle-Consistent Wasserstein GAN with Gradient Penalty (CycleWGAN-GP), and (iii) performs downstream condition assessment and crowd–structure interaction analysis with an optimized 2D-CNN. Using only structural sensors, the system infers aspects of crowd movement (e.g., speed and weight proxies), supports real-time safety decisions, and generalizes from unpaired training conditions to predict responses under future or unseen regimes. Validation is conducted on a laboratory-scale pedestrian timber bridge instrumented at midspan with three Fiber Bragg Grating (FBG) strain sensors under multiple scenarios that mimic moving human-induced loads. We evaluate generation quality with standard criteria and assess classification performance on both multiclass and binary tasks. Comparative studies include standard ML baselines and an ablation without CycleWGAN-GP. Results show improved missing-data generation with CycleWGAN-GP and robust condition monitoring on held-out, unseen real data (avoiding leakage): binary classification accuracy improved from 85.21 % to 95.40 %, while multiclass accuracy increased from 85.50 % to 96.65 %. The proposed framework enhances the predictive capability and reliability of bridge monitoring systems by jointly addressing noise, missingness, and crowd-induced variability within a unified SHM pipeline.</div></div>","PeriodicalId":50367,"journal":{"name":"Information Fusion","volume":"127 ","pages":"Article 103736"},"PeriodicalIF":15.5000,"publicationDate":"2025-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AAE-CycleWGAN fusion framework for generating fused strain data from sparse to dense domains in bridge monitoring systems\",\"authors\":\"Sahar Hassani , Ulrike Dackermann , Mohsen Mousavi , Samir Mustapha , Jianchun Li\",\"doi\":\"10.1016/j.inffus.2025.103736\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Effective monitoring of pedestrian bridges is challenged by noisy measurements, missing data, and time-varying crowd excitation–critical issues for infrastructure and crowd management where timely safety monitoring is paramount. In this work, we quantify human–structure interaction to enable a monitoring system that detects abnormal loads and supports bridge safety management. We also model structural responses under dense-occupancy conditions to predict behavior in busy scenarios, providing decision-ready insights that reduce the risk of serviceability loss. We propose a fusion-centred framework that (i) derives informative, noise-robust features from raw noisy structural strain responses via an optimized adversarial autoencoder (AAE) for denoising and dimensionality reduction, (ii) mitigates data scarcity by synthesizing missing fused modalities using a Cycle-Consistent Wasserstein GAN with Gradient Penalty (CycleWGAN-GP), and (iii) performs downstream condition assessment and crowd–structure interaction analysis with an optimized 2D-CNN. Using only structural sensors, the system infers aspects of crowd movement (e.g., speed and weight proxies), supports real-time safety decisions, and generalizes from unpaired training conditions to predict responses under future or unseen regimes. Validation is conducted on a laboratory-scale pedestrian timber bridge instrumented at midspan with three Fiber Bragg Grating (FBG) strain sensors under multiple scenarios that mimic moving human-induced loads. We evaluate generation quality with standard criteria and assess classification performance on both multiclass and binary tasks. Comparative studies include standard ML baselines and an ablation without CycleWGAN-GP. Results show improved missing-data generation with CycleWGAN-GP and robust condition monitoring on held-out, unseen real data (avoiding leakage): binary classification accuracy improved from 85.21 % to 95.40 %, while multiclass accuracy increased from 85.50 % to 96.65 %. The proposed framework enhances the predictive capability and reliability of bridge monitoring systems by jointly addressing noise, missingness, and crowd-induced variability within a unified SHM pipeline.</div></div>\",\"PeriodicalId\":50367,\"journal\":{\"name\":\"Information Fusion\",\"volume\":\"127 \",\"pages\":\"Article 103736\"},\"PeriodicalIF\":15.5000,\"publicationDate\":\"2025-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Fusion\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1566253525007985\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Fusion","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1566253525007985","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
有效的人行天桥监测受到噪声测量、数据缺失和时变人群兴奋的挑战,这些问题对基础设施和人群管理至关重要,及时的安全监测至关重要。在这项工作中,我们量化了人与结构的相互作用,使监测系统能够检测异常载荷并支持桥梁安全管理。我们还建立了密集占用条件下的结构响应模型,以预测繁忙情况下的行为,提供决策准备的见解,降低可使用性损失的风险。我们提出了一个以融合为中心的框架,该框架(i)通过优化的对抗性自编码器(AAE)从原始噪声结构应变响应中获得信息丰富的噪声鲁棒特征,用于去噪和降维;(ii)通过使用带梯度罚的循环一致Wasserstein GAN (CycleWGAN-GP)合成缺失融合模态来减轻数据稀缺性;(iii)使用优化的2D-CNN进行下游条件评估和人群-结构相互作用分析。仅使用结构传感器,该系统推断人群运动的各个方面(例如,速度和重量代理),支持实时安全决策,并从未配对的训练条件中进行归纳,以预测未来或不可见制度下的反应。在模拟移动人为载荷的多种场景下,在实验室规模的人行木桥上使用三个光纤布拉格光栅(FBG)应变传感器进行了验证。我们用标准标准评估生成质量,并在多类和二元任务上评估分类性能。比较研究包括标准ML基线和不使用CycleWGAN-GP的消融。结果表明,CycleWGAN-GP改进了缺失数据的生成,并对未见过的真实数据进行鲁棒状态监测(避免泄漏):二分类准确率从85.21%提高到95.40%,多分类准确率从85.50%提高到96.65%。提出的框架通过联合解决统一SHM管道内的噪声、缺失和人群引起的变化,提高了桥梁监测系统的预测能力和可靠性。
AAE-CycleWGAN fusion framework for generating fused strain data from sparse to dense domains in bridge monitoring systems
Effective monitoring of pedestrian bridges is challenged by noisy measurements, missing data, and time-varying crowd excitation–critical issues for infrastructure and crowd management where timely safety monitoring is paramount. In this work, we quantify human–structure interaction to enable a monitoring system that detects abnormal loads and supports bridge safety management. We also model structural responses under dense-occupancy conditions to predict behavior in busy scenarios, providing decision-ready insights that reduce the risk of serviceability loss. We propose a fusion-centred framework that (i) derives informative, noise-robust features from raw noisy structural strain responses via an optimized adversarial autoencoder (AAE) for denoising and dimensionality reduction, (ii) mitigates data scarcity by synthesizing missing fused modalities using a Cycle-Consistent Wasserstein GAN with Gradient Penalty (CycleWGAN-GP), and (iii) performs downstream condition assessment and crowd–structure interaction analysis with an optimized 2D-CNN. Using only structural sensors, the system infers aspects of crowd movement (e.g., speed and weight proxies), supports real-time safety decisions, and generalizes from unpaired training conditions to predict responses under future or unseen regimes. Validation is conducted on a laboratory-scale pedestrian timber bridge instrumented at midspan with three Fiber Bragg Grating (FBG) strain sensors under multiple scenarios that mimic moving human-induced loads. We evaluate generation quality with standard criteria and assess classification performance on both multiclass and binary tasks. Comparative studies include standard ML baselines and an ablation without CycleWGAN-GP. Results show improved missing-data generation with CycleWGAN-GP and robust condition monitoring on held-out, unseen real data (avoiding leakage): binary classification accuracy improved from 85.21 % to 95.40 %, while multiclass accuracy increased from 85.50 % to 96.65 %. The proposed framework enhances the predictive capability and reliability of bridge monitoring systems by jointly addressing noise, missingness, and crowd-induced variability within a unified SHM pipeline.
期刊介绍:
Information Fusion serves as a central platform for showcasing advancements in multi-sensor, multi-source, multi-process information fusion, fostering collaboration among diverse disciplines driving its progress. It is the leading outlet for sharing research and development in this field, focusing on architectures, algorithms, and applications. Papers dealing with fundamental theoretical analyses as well as those demonstrating their application to real-world problems will be welcome.