Ruohong Mei;Wei Sui;Jiaxin Zhang;Xue Qin;Gang Wang;Tao Peng;Tao Chen;Cong Yang
{"title":"RoMe: Towards Large Scale Road Surface Reconstruction via Mesh Representation","authors":"Ruohong Mei;Wei Sui;Jiaxin Zhang;Xue Qin;Gang Wang;Tao Peng;Tao Chen;Cong Yang","doi":"10.1109/TIV.2024.3417512","DOIUrl":"https://doi.org/10.1109/TIV.2024.3417512","url":null,"abstract":"In autonomous driving applications, accurate and efficient road surface reconstruction is paramount. This paper introduces RoMe, a novel framework designed for the robust reconstruction of large-scale road surfaces. Leveraging a unique mesh representation, RoMe ensures that the reconstructed road surfaces are accurate and seamlessly aligned with semantics. To address challenges in computational efficiency, we propose a waypoint sampling strategy, enabling RoMe to reconstruct vast environments by focusing on sub-areas and subsequently merging them. Furthermore, we incorporate an extrinsic optimization module to enhance the robustness against inaccuracies in extrinsic calibration. Our extensive evaluations of both public datasets and wild data underscore RoMe's superiority in terms of speed, accuracy, and robustness. For instance, it costs only 2 GPU hours to recover a road surface of \u0000<inline-formula><tex-math>$600times 600$</tex-math></inline-formula>\u0000 square meters from thousands of images. Notably, RoMe's capability extends beyond mere reconstruction, offering significant value for auto-labeling tasks in autonomous driving applications.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 7","pages":"5173-5185"},"PeriodicalIF":14.0,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142320504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"From RAG/RAT to SAGE for Social Transportation: A CoT and New Perspective on Smart Logistics and Mobility","authors":"Fei-Yue Wang","doi":"10.1109/TIV.2024.3426992","DOIUrl":"https://doi.org/10.1109/TIV.2024.3426992","url":null,"abstract":"Dear All","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 6","pages":"5005-5008"},"PeriodicalIF":14.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141965415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Enhancement Technology for Perception in Smart Mining Vehicles: 4D Millimeter-Wave Radar and Multi-Sensor Fusion","authors":"Jianjian Yang;Tianmu Gui;Yuyuan Zhang;Shirong Ge;Qiankun Huang;Guanghui Zhao","doi":"10.1109/TIV.2024.3427718","DOIUrl":"https://doi.org/10.1109/TIV.2024.3427718","url":null,"abstract":"Advancements in 4D mmWave radar with multi-sensor fusion have significantly enhanced the robustness of autonomous driving systems. In the context of “Mining 5.0” based on parallel intelligence theory, autonomous haulage need to achieve full autonomy in open-pit mines. Current systems use 3D mmWave radar, LiDAR, and cameras but have limited automation progress. This perspective discusses the limitations of these systems and how integrating 4D mmWave radar can improve mining autonomy. This perspective results from discussions at several recent Distributed/Decentralized Hybrid Workshops on Autonomous Mining (DHW-AM) and aims at enhancing the intelligence of future mining operations.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 6","pages":"5009-5013"},"PeriodicalIF":14.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141965412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"TechRxiv: Share Your Preprint Research with the World!","authors":"","doi":"10.1109/TIV.2024.3437221","DOIUrl":"https://doi.org/10.1109/TIV.2024.3437221","url":null,"abstract":"","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 6","pages":"5118-5118"},"PeriodicalIF":14.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10631816","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141965416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Imaginative Intelligence for Intelligent Vehicles: Sora Inspired New Directions for New Mobility and Vehicle Intelligence","authors":"Fei-Yue Wang","doi":"10.1109/TIV.2024.3393638","DOIUrl":"https://doi.org/10.1109/TIV.2024.3393638","url":null,"abstract":"The current issue includes 3 perspectives, 2 letters and 17 regular papers. These perspectives explore critical issues within the field of IVs and propose prospective research directions based on the evolution of foundation models. After \u0000<bold>Scanning the Issue</b>\u0000, I would like to share insights on how Sora-based imaginative intelligence could propel the future development of IVs.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 4","pages":"4557-4562"},"PeriodicalIF":8.2,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141315144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sora for Smart Mining: Towards Sustainability With Imaginative Intelligence and Parallel Intelligence","authors":"Yuting Xie;Cong Wang;Kunhua Liu;Zhe Xuanyuan;Yuhang He;Hui Cheng;Andreas Nüchter;Lingxi Li;Rouxing Huai;Shuming Tang;Siji Ma;Long Chen","doi":"10.1109/TIV.2024.3394520","DOIUrl":"https://doi.org/10.1109/TIV.2024.3394520","url":null,"abstract":"This letter summarizes discussions from IEEE TIV's Autonomous Mining Workshop, emphasizing the potential of video generation models in advancing smart mining.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 4","pages":"4577-4578"},"PeriodicalIF":8.2,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141315192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christian Creß;Walter Zimmer;Nils Purschke;Bach Ngoc Doan;Sven Kirchner;Venkatnarayanan Lakshminarasimhan;Leah Strand;Alois C. Knoll
{"title":"TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Cameras","authors":"Christian Creß;Walter Zimmer;Nils Purschke;Bach Ngoc Doan;Sven Kirchner;Venkatnarayanan Lakshminarasimhan;Leah Strand;Alois C. Knoll","doi":"10.1109/TIV.2024.3393749","DOIUrl":"https://doi.org/10.1109/TIV.2024.3393749","url":null,"abstract":"Event-based cameras are predestined for Intelligent Transportation Systems (ITS). They provide very high temporal resolution and dynamic range, which can eliminate motion blur and improve detection performance at night. However, event-based images lack color and texture compared to images from a conventional RGB camera. Considering that, data fusion between event-based and conventional cameras can combine the strengths of both modalities. For this purpose, extrinsic calibration is necessary. To the best of our knowledge, no targetless calibration between event-based and RGB cameras can handle multiple moving objects, nor does data fusion optimized for the domain of roadside ITS exist. Furthermore, synchronized event-based and RGB camera datasets considering roadside perspective are not yet published. To fill these research gaps, based on our previous work, we extended our targetless calibration approach with clustering methods to handle multiple moving objects. Furthermore, we developed an Early Fusion, Simple Late Fusion, and a novel Spatiotemporal Late Fusion method. Lastly, we published the TUMTraf Event Dataset, which contains more than 4,111 synchronized event-based and RGB images with 50,496 labeled 2D boxes. During our extensive experiments, we verified the effectiveness of our calibration method with multiple moving objects. Furthermore, compared to a single RGB camera, we increased the detection performance of up to +9% mAP in the day and up to +13% mAP during the challenging night with our presented event-based sensor fusion methods.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"9 7","pages":"5186-5203"},"PeriodicalIF":14.0,"publicationDate":"2024-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10508494","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142320476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}