弱监督自动驾驶语义分割的环境适应

IF 6.9 1区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Yongqiang Li , Chuanping Hu , Kai Ren , Hao Xi , Jinhao Fan
{"title":"弱监督自动驾驶语义分割的环境适应","authors":"Yongqiang Li ,&nbsp;Chuanping Hu ,&nbsp;Kai Ren ,&nbsp;Hao Xi ,&nbsp;Jinhao Fan","doi":"10.1016/j.ipm.2025.104349","DOIUrl":null,"url":null,"abstract":"<div><div>Weakly supervised semantic segmentation (WSSS) offers a promising solution to reduce annotation costs in autonomous driving perception systems. However, existing methods struggle with the complex environmental conditions inherent to real-world driving scenarios, including adverse weather, variable lighting, and challenging visibility conditions. To address these limitations, we introduce EASeg, a novel framework that enhances segmentation robustness across diverse environmental conditions while requiring only image-level supervision. Our approach introduces three key innovations: (1) a multi-scale feature module that captures objects at varying scales followed by a boundary-aware enhancement component for precise delineation; (2) a dual-stream environmental adaptation mechanism that separately models global weather patterns and local illumination variations; and (3) a reliability-guided feature integration strategy that dynamically combines backbone features with foundation models based on their estimated reliability. Extensive experiments demonstrate that EASeg outperforms previous best methods, increasing mIoU by 24.5% on Cityscapes, 27.5% on CamVid, and 22.5% on WildDash2. Ablation studies confirm that our work represents a significant advancement toward practical, all-weather autonomous driving systems that enhance safety through improved segmentation of small objects and precise boundary delineation, while minimizing annotation requirements.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"63 1","pages":"Article 104349"},"PeriodicalIF":6.9000,"publicationDate":"2025-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"EASeg: Environmental adaptation for weakly-supervised autonomous driving semantic segmentation\",\"authors\":\"Yongqiang Li ,&nbsp;Chuanping Hu ,&nbsp;Kai Ren ,&nbsp;Hao Xi ,&nbsp;Jinhao Fan\",\"doi\":\"10.1016/j.ipm.2025.104349\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Weakly supervised semantic segmentation (WSSS) offers a promising solution to reduce annotation costs in autonomous driving perception systems. However, existing methods struggle with the complex environmental conditions inherent to real-world driving scenarios, including adverse weather, variable lighting, and challenging visibility conditions. To address these limitations, we introduce EASeg, a novel framework that enhances segmentation robustness across diverse environmental conditions while requiring only image-level supervision. Our approach introduces three key innovations: (1) a multi-scale feature module that captures objects at varying scales followed by a boundary-aware enhancement component for precise delineation; (2) a dual-stream environmental adaptation mechanism that separately models global weather patterns and local illumination variations; and (3) a reliability-guided feature integration strategy that dynamically combines backbone features with foundation models based on their estimated reliability. Extensive experiments demonstrate that EASeg outperforms previous best methods, increasing mIoU by 24.5% on Cityscapes, 27.5% on CamVid, and 22.5% on WildDash2. Ablation studies confirm that our work represents a significant advancement toward practical, all-weather autonomous driving systems that enhance safety through improved segmentation of small objects and precise boundary delineation, while minimizing annotation requirements.</div></div>\",\"PeriodicalId\":50365,\"journal\":{\"name\":\"Information Processing & Management\",\"volume\":\"63 1\",\"pages\":\"Article 104349\"},\"PeriodicalIF\":6.9000,\"publicationDate\":\"2025-08-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Processing & Management\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306457325002900\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457325002900","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

弱监督语义分割(WSSS)为降低自动驾驶感知系统的标注成本提供了一种很有前景的解决方案。然而,现有的方法难以应对现实驾驶场景中固有的复杂环境条件,包括恶劣天气、多变的照明和具有挑战性的能见度条件。为了解决这些限制,我们引入了EASeg,这是一个新的框架,可以增强不同环境条件下的分割鲁棒性,同时只需要图像级监督。我们的方法引入了三个关键创新:(1)一个多尺度特征模块,用于捕获不同尺度的物体,然后是一个边界感知增强组件,用于精确描绘;(2)分别模拟全球气候模式和局部光照变化的双流环境适应机制;(3)基于主干网特征与基础模型的可靠性估计动态结合的可靠性导向特征集成策略。大量的实验表明EASeg优于之前的最佳方法,在cityscape上增加了24.5%的mIoU,在CamVid上增加了27.5%,在WildDash2上增加了22.5%。消融研究证实,我们的工作代表了实用、全天候自动驾驶系统的重大进步,该系统通过改进小物体的分割和精确的边界划定来提高安全性,同时最大限度地减少注释要求。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
EASeg: Environmental adaptation for weakly-supervised autonomous driving semantic segmentation
Weakly supervised semantic segmentation (WSSS) offers a promising solution to reduce annotation costs in autonomous driving perception systems. However, existing methods struggle with the complex environmental conditions inherent to real-world driving scenarios, including adverse weather, variable lighting, and challenging visibility conditions. To address these limitations, we introduce EASeg, a novel framework that enhances segmentation robustness across diverse environmental conditions while requiring only image-level supervision. Our approach introduces three key innovations: (1) a multi-scale feature module that captures objects at varying scales followed by a boundary-aware enhancement component for precise delineation; (2) a dual-stream environmental adaptation mechanism that separately models global weather patterns and local illumination variations; and (3) a reliability-guided feature integration strategy that dynamically combines backbone features with foundation models based on their estimated reliability. Extensive experiments demonstrate that EASeg outperforms previous best methods, increasing mIoU by 24.5% on Cityscapes, 27.5% on CamVid, and 22.5% on WildDash2. Ablation studies confirm that our work represents a significant advancement toward practical, all-weather autonomous driving systems that enhance safety through improved segmentation of small objects and precise boundary delineation, while minimizing annotation requirements.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Information Processing & Management
Information Processing & Management 工程技术-计算机:信息系统
CiteScore
17.00
自引率
11.60%
发文量
276
审稿时长
39 days
期刊介绍: Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing. We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信