可信人工智能的场景工程:利用合成数据进行再识别的领域适应方法

IF 8.6 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Xuan Li;Xiao Wang;Fang Deng;Fei-Yue Wang
{"title":"可信人工智能的场景工程:利用合成数据进行再识别的领域适应方法","authors":"Xuan Li;Xiao Wang;Fang Deng;Fei-Yue Wang","doi":"10.1109/TSMC.2024.3445117","DOIUrl":null,"url":null,"abstract":"Reidentification (Re-ID) is a crucial computer vision application with a variety of potential uses in many maritime scenarios, including search, rescue, and surveillance. However, the development of advanced boat reidentification (Boat Re-ID) algorithms necessitates the availability of large-scale Re-ID datasets for model training and evaluation. Inspired by scenarios engineering, this study proposes a new framework for automatically generating a realistic synthetic dataset for boat Re-ID investigation. The synthetic dataset contains 107 boat models and various visual conditions in 36 real backgrounds. The use of synthetic datasets enables the learning-based Re-ID algorithm’s performance to be quantitatively verificated under varying imaging conditions. Nonetheless, our experiments prove that synthetic datasets are inadequate to handle real-world challenges. Therefore, we present a domain adaptation approach that integrates both real and synthetic data to create trustworthy models. This approach employs a multistep training strategy, gradient reversal layer and novel loss functions to preserve the features from two distribution dataset domains. The results of the experiments demonstrate that 1) synthetic datasets can be employed to train boat Re-ID algorithms and quantitatively test the performance of these algorithms under diverse imaging conditions and 2) our approach utilizes the attributes of the two data domains (real and synthetic) to achieve exceptional performance in real-world applications.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":null,"pages":null},"PeriodicalIF":8.6000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Scenarios Engineering for Trustworthy AI: Domain Adaptation Approach for Reidentification With Synthetic Data\",\"authors\":\"Xuan Li;Xiao Wang;Fang Deng;Fei-Yue Wang\",\"doi\":\"10.1109/TSMC.2024.3445117\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reidentification (Re-ID) is a crucial computer vision application with a variety of potential uses in many maritime scenarios, including search, rescue, and surveillance. However, the development of advanced boat reidentification (Boat Re-ID) algorithms necessitates the availability of large-scale Re-ID datasets for model training and evaluation. Inspired by scenarios engineering, this study proposes a new framework for automatically generating a realistic synthetic dataset for boat Re-ID investigation. The synthetic dataset contains 107 boat models and various visual conditions in 36 real backgrounds. The use of synthetic datasets enables the learning-based Re-ID algorithm’s performance to be quantitatively verificated under varying imaging conditions. Nonetheless, our experiments prove that synthetic datasets are inadequate to handle real-world challenges. Therefore, we present a domain adaptation approach that integrates both real and synthetic data to create trustworthy models. This approach employs a multistep training strategy, gradient reversal layer and novel loss functions to preserve the features from two distribution dataset domains. The results of the experiments demonstrate that 1) synthetic datasets can be employed to train boat Re-ID algorithms and quantitatively test the performance of these algorithms under diverse imaging conditions and 2) our approach utilizes the attributes of the two data domains (real and synthetic) to achieve exceptional performance in real-world applications.\",\"PeriodicalId\":48915,\"journal\":{\"name\":\"IEEE Transactions on Systems Man Cybernetics-Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-09-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Systems Man Cybernetics-Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10665751/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10665751/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

重新识别(Re-ID)是一项重要的计算机视觉应用,在搜索、救援和监视等多种海事场景中具有多种潜在用途。然而,要开发先进的船只再识别(Boat Re-ID)算法,就必须要有大规模的再识别数据集来进行模型训练和评估。受场景工程学的启发,本研究提出了一种新的框架,用于自动生成用于船只再识别研究的真实合成数据集。合成数据集包含 107 个船只模型和 36 个真实背景中的各种视觉条件。使用合成数据集可以在不同的成像条件下定量验证基于学习的重新识别算法的性能。然而,我们的实验证明,合成数据集不足以应对真实世界的挑战。因此,我们提出了一种领域适应方法,将真实数据和合成数据整合在一起,创建值得信赖的模型。这种方法采用多步训练策略、梯度反转层和新颖的损失函数来保留两个分布数据集域的特征。实验结果表明:1)合成数据集可用于训练船型再识别算法,并定量测试这些算法在不同成像条件下的性能;2)我们的方法利用了两个数据域(真实和合成)的属性,在真实世界的应用中取得了优异的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Scenarios Engineering for Trustworthy AI: Domain Adaptation Approach for Reidentification With Synthetic Data
Reidentification (Re-ID) is a crucial computer vision application with a variety of potential uses in many maritime scenarios, including search, rescue, and surveillance. However, the development of advanced boat reidentification (Boat Re-ID) algorithms necessitates the availability of large-scale Re-ID datasets for model training and evaluation. Inspired by scenarios engineering, this study proposes a new framework for automatically generating a realistic synthetic dataset for boat Re-ID investigation. The synthetic dataset contains 107 boat models and various visual conditions in 36 real backgrounds. The use of synthetic datasets enables the learning-based Re-ID algorithm’s performance to be quantitatively verificated under varying imaging conditions. Nonetheless, our experiments prove that synthetic datasets are inadequate to handle real-world challenges. Therefore, we present a domain adaptation approach that integrates both real and synthetic data to create trustworthy models. This approach employs a multistep training strategy, gradient reversal layer and novel loss functions to preserve the features from two distribution dataset domains. The results of the experiments demonstrate that 1) synthetic datasets can be employed to train boat Re-ID algorithms and quantitatively test the performance of these algorithms under diverse imaging conditions and 2) our approach utilizes the attributes of the two data domains (real and synthetic) to achieve exceptional performance in real-world applications.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Systems Man Cybernetics-Systems
IEEE Transactions on Systems Man Cybernetics-Systems AUTOMATION & CONTROL SYSTEMS-COMPUTER SCIENCE, CYBERNETICS
CiteScore
18.50
自引率
11.50%
发文量
812
审稿时长
6 months
期刊介绍: The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信