{"title":"Efficient Stereo Matching With Adaptive Disparity Range Scaling and Feature Calibration","authors":"Shengjie Huang;Runbang Zhang;Shuo Liu;Yougang Bian;Yunshui Zhou;Xiaohui Qin","doi":"10.1109/JSEN.2024.3491173","DOIUrl":null,"url":null,"abstract":"Cascaded cost volume-based stereo matching has gained significant attention for its ability to produce high-resolution depth maps with efficient hardware utilization. However, previous methods often perform uniform offset sampling within a predicted disparity range, which can easily overlook the ground-truth disparity, leading to error propagation and accumulation. Moreover, these methods lack specific designs to tackle spatial feature misalignment, which limits their effectiveness in real-time applications. In this article, we introduce a lightweight cascaded stereo matching framework that features a disparity range scaling (DRS) module and a spatial feature calibration (SFC) module. The DRS module adaptively adjusts the disparity sampling range and constructs a new cost volume that incorporates finer semantic features, ensuring that computational and memory resources are focused on more critical regions. The SFC module performs selective sampling and calibration to extract the most informative and representative features at each position, effectively mitigating spatial feature misalignment. Through rigorous experiments across SceneFlow, KITTI 2012, and KITTI 2015, our model’s effectiveness and efficiency have been confirmed, demonstrating that it outperforms other speed-based algorithms while remaining competitive with state-of-the-art approaches.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"24 24","pages":"42561-42572"},"PeriodicalIF":4.3000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10750257/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Cascaded cost volume-based stereo matching has gained significant attention for its ability to produce high-resolution depth maps with efficient hardware utilization. However, previous methods often perform uniform offset sampling within a predicted disparity range, which can easily overlook the ground-truth disparity, leading to error propagation and accumulation. Moreover, these methods lack specific designs to tackle spatial feature misalignment, which limits their effectiveness in real-time applications. In this article, we introduce a lightweight cascaded stereo matching framework that features a disparity range scaling (DRS) module and a spatial feature calibration (SFC) module. The DRS module adaptively adjusts the disparity sampling range and constructs a new cost volume that incorporates finer semantic features, ensuring that computational and memory resources are focused on more critical regions. The SFC module performs selective sampling and calibration to extract the most informative and representative features at each position, effectively mitigating spatial feature misalignment. Through rigorous experiments across SceneFlow, KITTI 2012, and KITTI 2015, our model’s effectiveness and efficiency have been confirmed, demonstrating that it outperforms other speed-based algorithms while remaining competitive with state-of-the-art approaches.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice