3PFS:通过人脸交换保护行人隐私

IF 7.9 1区 工程技术 Q1 ENGINEERING, CIVIL
Zixian Zhao;Xingchen Zhang;Yiannis Demiris
{"title":"3PFS:通过人脸交换保护行人隐私","authors":"Zixian Zhao;Xingchen Zhang;Yiannis Demiris","doi":"10.1109/TITS.2024.3421917","DOIUrl":null,"url":null,"abstract":"In the era of artificial intelligence, privacy has become a paramount concern, especially within intelligent transportation systems (ITS) where pedestrians are frequently captured by vehicle-mounted cameras for deep learning model training. To address this, we introduce 3PFS, a novel method designed to protect pedestrian privacy via face swapping while preserving the utility of processed images. Our method consists of a pedestrian detector, a face detector, a pre-processing module, a source face selection algorithm, and a face swapping algorithm. After detecting pedestrians and their corresponding faces, the pre-processing module enhances image quality. Our unique source face selection algorithm then chooses an appropriate face from our source face library, which is subsequently swapped with the target face using a face swapping algorithm. Notably, with the combination of a pedestrian tracking algorithm, our 3PFS is well-suited for video anonymization. Additionally, we propose a comprehensive evaluation strategy to evaluate the performance of pedestrian anonymization methods. We validate the effectiveness of 3PFS through extensive experiments on a dataset we created based on the publicly available JAAD dataset and on videos captured using our robotic wheelchair.","PeriodicalId":13416,"journal":{"name":"IEEE Transactions on Intelligent Transportation Systems","volume":"25 11","pages":"16845-16854"},"PeriodicalIF":7.9000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"3PFS: Protecting Pedestrian Privacy Through Face Swapping\",\"authors\":\"Zixian Zhao;Xingchen Zhang;Yiannis Demiris\",\"doi\":\"10.1109/TITS.2024.3421917\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the era of artificial intelligence, privacy has become a paramount concern, especially within intelligent transportation systems (ITS) where pedestrians are frequently captured by vehicle-mounted cameras for deep learning model training. To address this, we introduce 3PFS, a novel method designed to protect pedestrian privacy via face swapping while preserving the utility of processed images. Our method consists of a pedestrian detector, a face detector, a pre-processing module, a source face selection algorithm, and a face swapping algorithm. After detecting pedestrians and their corresponding faces, the pre-processing module enhances image quality. Our unique source face selection algorithm then chooses an appropriate face from our source face library, which is subsequently swapped with the target face using a face swapping algorithm. Notably, with the combination of a pedestrian tracking algorithm, our 3PFS is well-suited for video anonymization. Additionally, we propose a comprehensive evaluation strategy to evaluate the performance of pedestrian anonymization methods. We validate the effectiveness of 3PFS through extensive experiments on a dataset we created based on the publicly available JAAD dataset and on videos captured using our robotic wheelchair.\",\"PeriodicalId\":13416,\"journal\":{\"name\":\"IEEE Transactions on Intelligent Transportation Systems\",\"volume\":\"25 11\",\"pages\":\"16845-16854\"},\"PeriodicalIF\":7.9000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Intelligent Transportation Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10682960/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Transportation Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10682960/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

摘要

在人工智能时代,隐私已成为人们最关心的问题,尤其是在智能交通系统(ITS)中,行人经常被车载摄像头捕捉,用于深度学习模型训练。为了解决这个问题,我们推出了 3PFS,这是一种新颖的方法,旨在通过人脸交换保护行人隐私,同时保留处理后图像的实用性。我们的方法由行人检测器、人脸检测器、预处理模块、源人脸选择算法和人脸交换算法组成。在检测到行人及其相应的人脸后,预处理模块会提高图像质量。然后,我们独特的源人脸选择算法会从源人脸库中选择一个合适的人脸,然后使用人脸交换算法将其与目标人脸进行交换。值得注意的是,结合行人跟踪算法,我们的 3PFS 非常适合视频匿名化。此外,我们还提出了一种综合评估策略来评估行人匿名化方法的性能。我们在基于公开可用的 JAAD 数据集创建的数据集和使用机器人轮椅拍摄的视频上进行了大量实验,验证了 3PFS 的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
3PFS: Protecting Pedestrian Privacy Through Face Swapping
In the era of artificial intelligence, privacy has become a paramount concern, especially within intelligent transportation systems (ITS) where pedestrians are frequently captured by vehicle-mounted cameras for deep learning model training. To address this, we introduce 3PFS, a novel method designed to protect pedestrian privacy via face swapping while preserving the utility of processed images. Our method consists of a pedestrian detector, a face detector, a pre-processing module, a source face selection algorithm, and a face swapping algorithm. After detecting pedestrians and their corresponding faces, the pre-processing module enhances image quality. Our unique source face selection algorithm then chooses an appropriate face from our source face library, which is subsequently swapped with the target face using a face swapping algorithm. Notably, with the combination of a pedestrian tracking algorithm, our 3PFS is well-suited for video anonymization. Additionally, we propose a comprehensive evaluation strategy to evaluate the performance of pedestrian anonymization methods. We validate the effectiveness of 3PFS through extensive experiments on a dataset we created based on the publicly available JAAD dataset and on videos captured using our robotic wheelchair.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Intelligent Transportation Systems
IEEE Transactions on Intelligent Transportation Systems 工程技术-工程:电子与电气
CiteScore
14.80
自引率
12.90%
发文量
1872
审稿时长
7.5 months
期刊介绍: The theoretical, experimental and operational aspects of electrical and electronics engineering and information technologies as applied to Intelligent Transportation Systems (ITS). Intelligent Transportation Systems are defined as those systems utilizing synergistic technologies and systems engineering concepts to develop and improve transportation systems of all kinds. The scope of this interdisciplinary activity includes the promotion, consolidation and coordination of ITS technical activities among IEEE entities, and providing a focus for cooperative activities, both internally and externally.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信