{"title":"利用环境制图进行室内雷达幽灵识别的数据驱动方法","authors":"Ruizhi Liu;Xinghui Song;Jiawei Qian;Shuai Hao;Yue Lin;Hongtao Xu","doi":"10.1109/TRS.2024.3456891","DOIUrl":null,"url":null,"abstract":"Millimeter-wave (mmWave) radar has been widely applied in target detection. However, due to multipath and occlusion, radar often detects ghosts, especially in indoor environments. Existing solutions are mostly tailored to specific, simplified scenarios. To identify radar ghosts in diverse and complex indoor environments, we propose a data-driven approach. A thoughtful indoor radar ghost dataset is created with a multimodal data acquisition and automatic annotation system. And PairwiseNet, an end-to-end deep neural network adept at handling point-pair relationships within sparse point clouds, is proposed for radar ghost recognition. Multiframe accumulation is also implemented in PairwiseNet. To further enhance PairwiseNet, an additional network incorporating grid maps and U-Net is developed for constructing environmental maps from sequential point clouds. This network is trained through cross-modal distillation, with a depth camera as the teacher. Finally, a series of experiments validates the effectiveness of the proposed method in identifying indoor radar ghosts and autonomously constructing environmental maps. The classification accuracy on the test set reaches 96.0%, accurately identifying ghosts in the vast majority of cases.","PeriodicalId":100645,"journal":{"name":"IEEE Transactions on Radar Systems","volume":"2 ","pages":"910-923"},"PeriodicalIF":0.0000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Data-Driven Method for Indoor Radar Ghost Recognition With Environmental Mapping\",\"authors\":\"Ruizhi Liu;Xinghui Song;Jiawei Qian;Shuai Hao;Yue Lin;Hongtao Xu\",\"doi\":\"10.1109/TRS.2024.3456891\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Millimeter-wave (mmWave) radar has been widely applied in target detection. However, due to multipath and occlusion, radar often detects ghosts, especially in indoor environments. Existing solutions are mostly tailored to specific, simplified scenarios. To identify radar ghosts in diverse and complex indoor environments, we propose a data-driven approach. A thoughtful indoor radar ghost dataset is created with a multimodal data acquisition and automatic annotation system. And PairwiseNet, an end-to-end deep neural network adept at handling point-pair relationships within sparse point clouds, is proposed for radar ghost recognition. Multiframe accumulation is also implemented in PairwiseNet. To further enhance PairwiseNet, an additional network incorporating grid maps and U-Net is developed for constructing environmental maps from sequential point clouds. This network is trained through cross-modal distillation, with a depth camera as the teacher. Finally, a series of experiments validates the effectiveness of the proposed method in identifying indoor radar ghosts and autonomously constructing environmental maps. The classification accuracy on the test set reaches 96.0%, accurately identifying ghosts in the vast majority of cases.\",\"PeriodicalId\":100645,\"journal\":{\"name\":\"IEEE Transactions on Radar Systems\",\"volume\":\"2 \",\"pages\":\"910-923\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Radar Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10672544/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Radar Systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10672544/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Data-Driven Method for Indoor Radar Ghost Recognition With Environmental Mapping
Millimeter-wave (mmWave) radar has been widely applied in target detection. However, due to multipath and occlusion, radar often detects ghosts, especially in indoor environments. Existing solutions are mostly tailored to specific, simplified scenarios. To identify radar ghosts in diverse and complex indoor environments, we propose a data-driven approach. A thoughtful indoor radar ghost dataset is created with a multimodal data acquisition and automatic annotation system. And PairwiseNet, an end-to-end deep neural network adept at handling point-pair relationships within sparse point clouds, is proposed for radar ghost recognition. Multiframe accumulation is also implemented in PairwiseNet. To further enhance PairwiseNet, an additional network incorporating grid maps and U-Net is developed for constructing environmental maps from sequential point clouds. This network is trained through cross-modal distillation, with a depth camera as the teacher. Finally, a series of experiments validates the effectiveness of the proposed method in identifying indoor radar ghosts and autonomously constructing environmental maps. The classification accuracy on the test set reaches 96.0%, accurately identifying ghosts in the vast majority of cases.