{"title":"用于室内停车场数据集的新型车牌去识别方法","authors":"Seung Ho Nam, Hong Seong Park","doi":"10.1007/s42835-024-02033-0","DOIUrl":null,"url":null,"abstract":"<p>This paper addresses de-identification problem of vehicle license plates in image-based datasets crucial for autonomous driving and robotics research. Traditional methods such as blurring and masking used for privacy protection reduce data quality by obscuring key features like license plates, limiting the utility of datasets. To overcome this, this paper introduces a new method that retains original data quality while anonymizing license plates by combining detection, vertices identification, and generation of virtual license plates resembling textures of the original. The approach utilizes advanced models such as YOLOv8x and Swin Transformer, enhanced by the Weighted Box Fusion ensemble technique, to improve the detection accuracy of license plates in complex indoor parking lot environments characterized by poor lighting and varied vehicle positions. This method enhances the accuracy of detecting multiple license plates in a single image, isolating images with only one vehicle for further processing. The RetinaFace model identifies the precise positions (or 4 vertices) of license plates and the perspective transformation technique replaces the original plates with virtual ones using the identified vertices. These virtual plates are randomly generated but initially do not match the original plates' texture, making them obviously artificial. To address this, a finely adjusted CycleGAN model adapts the texture of the virtual plates to closely resemble the originals. Finally, the modified plates are merged back with the original vehicle images, ensuring that the dataset retains the visual similarity to the original images while effectively making de-identification of the license plates for privacy. The effectiveness of the proposed de-identification method is validated by comparing its performance with various deep learning models in an indoor parking environment.</p>","PeriodicalId":15577,"journal":{"name":"Journal of Electrical Engineering & Technology","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A New License Plate De-Identification Method for Indoor Parking Lot Datasets\",\"authors\":\"Seung Ho Nam, Hong Seong Park\",\"doi\":\"10.1007/s42835-024-02033-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>This paper addresses de-identification problem of vehicle license plates in image-based datasets crucial for autonomous driving and robotics research. Traditional methods such as blurring and masking used for privacy protection reduce data quality by obscuring key features like license plates, limiting the utility of datasets. To overcome this, this paper introduces a new method that retains original data quality while anonymizing license plates by combining detection, vertices identification, and generation of virtual license plates resembling textures of the original. The approach utilizes advanced models such as YOLOv8x and Swin Transformer, enhanced by the Weighted Box Fusion ensemble technique, to improve the detection accuracy of license plates in complex indoor parking lot environments characterized by poor lighting and varied vehicle positions. This method enhances the accuracy of detecting multiple license plates in a single image, isolating images with only one vehicle for further processing. The RetinaFace model identifies the precise positions (or 4 vertices) of license plates and the perspective transformation technique replaces the original plates with virtual ones using the identified vertices. These virtual plates are randomly generated but initially do not match the original plates' texture, making them obviously artificial. To address this, a finely adjusted CycleGAN model adapts the texture of the virtual plates to closely resemble the originals. Finally, the modified plates are merged back with the original vehicle images, ensuring that the dataset retains the visual similarity to the original images while effectively making de-identification of the license plates for privacy. The effectiveness of the proposed de-identification method is validated by comparing its performance with various deep learning models in an indoor parking environment.</p>\",\"PeriodicalId\":15577,\"journal\":{\"name\":\"Journal of Electrical Engineering & Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2024-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Electrical Engineering & Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s42835-024-02033-0\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Electrical Engineering & Technology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s42835-024-02033-0","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A New License Plate De-Identification Method for Indoor Parking Lot Datasets
This paper addresses de-identification problem of vehicle license plates in image-based datasets crucial for autonomous driving and robotics research. Traditional methods such as blurring and masking used for privacy protection reduce data quality by obscuring key features like license plates, limiting the utility of datasets. To overcome this, this paper introduces a new method that retains original data quality while anonymizing license plates by combining detection, vertices identification, and generation of virtual license plates resembling textures of the original. The approach utilizes advanced models such as YOLOv8x and Swin Transformer, enhanced by the Weighted Box Fusion ensemble technique, to improve the detection accuracy of license plates in complex indoor parking lot environments characterized by poor lighting and varied vehicle positions. This method enhances the accuracy of detecting multiple license plates in a single image, isolating images with only one vehicle for further processing. The RetinaFace model identifies the precise positions (or 4 vertices) of license plates and the perspective transformation technique replaces the original plates with virtual ones using the identified vertices. These virtual plates are randomly generated but initially do not match the original plates' texture, making them obviously artificial. To address this, a finely adjusted CycleGAN model adapts the texture of the virtual plates to closely resemble the originals. Finally, the modified plates are merged back with the original vehicle images, ensuring that the dataset retains the visual similarity to the original images while effectively making de-identification of the license plates for privacy. The effectiveness of the proposed de-identification method is validated by comparing its performance with various deep learning models in an indoor parking environment.
期刊介绍:
ournal of Electrical Engineering and Technology (JEET), which is the official publication of the Korean Institute of Electrical Engineers (KIEE) being published bimonthly, released the first issue in March 2006.The journal is open to submission from scholars and experts in the wide areas of electrical engineering technologies.
The scope of the journal includes all issues in the field of Electrical Engineering and Technology. Included are techniques for electrical power engineering, electrical machinery and energy conversion systems, electrophysics and applications, information and controls.