{"title":"利用变异自动编码器和归一化流量进行车道检测以实现自动驾驶","authors":"Jingyue Shi;Junhui Zhao;Dongming Wang;Hong Tang","doi":"10.1109/TITS.2024.3471640","DOIUrl":null,"url":null,"abstract":"Mainstream lane detection methods often lack flexibility, accuracy, and efficiency in challenging scenarios, especially with occlusion and extreme lighting. To address this, we reframe lane detection as a variational inference problem. Specifically, we propose a Variational Lane Detection Network (VLD-Net) using a Conditional Variational Auto-Encoder (CVAE) as the generative network to produce multiple lane maps as candidates, supervised by the ground-truth lane map. To build a more complex, expressive probability distribution, we incorporate normalizing flows into lane map generation, enhancing realism. Additionally, we develop a Lane-Attention Fusion (LAF) module using attention mechanisms to adaptively fuse generated candidate lane maps. LAF also includes a lane local feature aggregator to enhance local lane keypoint correlation. Experimental results on TuSimple and CULane datasets show our method outperforms previous approaches in challenging scenarios.","PeriodicalId":13416,"journal":{"name":"IEEE Transactions on Intelligent Transportation Systems","volume":"25 12","pages":"21757-21768"},"PeriodicalIF":7.9000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Lane Detection by Variational Auto-Encoder With Normalizing Flow for Autonomous Driving\",\"authors\":\"Jingyue Shi;Junhui Zhao;Dongming Wang;Hong Tang\",\"doi\":\"10.1109/TITS.2024.3471640\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Mainstream lane detection methods often lack flexibility, accuracy, and efficiency in challenging scenarios, especially with occlusion and extreme lighting. To address this, we reframe lane detection as a variational inference problem. Specifically, we propose a Variational Lane Detection Network (VLD-Net) using a Conditional Variational Auto-Encoder (CVAE) as the generative network to produce multiple lane maps as candidates, supervised by the ground-truth lane map. To build a more complex, expressive probability distribution, we incorporate normalizing flows into lane map generation, enhancing realism. Additionally, we develop a Lane-Attention Fusion (LAF) module using attention mechanisms to adaptively fuse generated candidate lane maps. LAF also includes a lane local feature aggregator to enhance local lane keypoint correlation. Experimental results on TuSimple and CULane datasets show our method outperforms previous approaches in challenging scenarios.\",\"PeriodicalId\":13416,\"journal\":{\"name\":\"IEEE Transactions on Intelligent Transportation Systems\",\"volume\":\"25 12\",\"pages\":\"21757-21768\"},\"PeriodicalIF\":7.9000,\"publicationDate\":\"2024-10-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Intelligent Transportation Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10713095/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Transportation Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10713095/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
Lane Detection by Variational Auto-Encoder With Normalizing Flow for Autonomous Driving
Mainstream lane detection methods often lack flexibility, accuracy, and efficiency in challenging scenarios, especially with occlusion and extreme lighting. To address this, we reframe lane detection as a variational inference problem. Specifically, we propose a Variational Lane Detection Network (VLD-Net) using a Conditional Variational Auto-Encoder (CVAE) as the generative network to produce multiple lane maps as candidates, supervised by the ground-truth lane map. To build a more complex, expressive probability distribution, we incorporate normalizing flows into lane map generation, enhancing realism. Additionally, we develop a Lane-Attention Fusion (LAF) module using attention mechanisms to adaptively fuse generated candidate lane maps. LAF also includes a lane local feature aggregator to enhance local lane keypoint correlation. Experimental results on TuSimple and CULane datasets show our method outperforms previous approaches in challenging scenarios.
期刊介绍:
The theoretical, experimental and operational aspects of electrical and electronics engineering and information technologies as applied to Intelligent Transportation Systems (ITS). Intelligent Transportation Systems are defined as those systems utilizing synergistic technologies and systems engineering concepts to develop and improve transportation systems of all kinds. The scope of this interdisciplinary activity includes the promotion, consolidation and coordination of ITS technical activities among IEEE entities, and providing a focus for cooperative activities, both internally and externally.