Multi-attribute balanced dataset generation framework AutoSyn and KinFace Channel-Spatial Feature Extractor for kinship recognition

IF 5.5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Jia-Xuan Jiang , Hongsheng Jing , Ling Zhou , Yuee Li , Zhong Wang
{"title":"Multi-attribute balanced dataset generation framework AutoSyn and KinFace Channel-Spatial Feature Extractor for kinship recognition","authors":"Jia-Xuan Jiang ,&nbsp;Hongsheng Jing ,&nbsp;Ling Zhou ,&nbsp;Yuee Li ,&nbsp;Zhong Wang","doi":"10.1016/j.neucom.2024.128750","DOIUrl":null,"url":null,"abstract":"<div><div>In the field of kinship verification, facial recognition technology is becoming increasingly vital due to privacy concerns, ethical disputes, and the high costs associated with DNA testing. We have developed a novel method, the AutoSyn framework, to synthesize facial images and enhance kinship image datasets, effectively addressing the challenges of scale and quality in existing datasets. By employing a strategy that mixes ages and genders in the synthesized images, we minimize the impact of these factors on kinship recognition tasks. We have enhanced the original KinFaceW-I dataset by integrating ten distinct styles, including diverse combinations of gender, ethnicity, and age. This enrichment significantly improves both the quality and quantity of the images. Furthermore, this paper introduces an efficient feature extractor for kinship tasks, KinFace-CSFE, within a siamese neural network framework. This model not only utilizes meticulously designed channel feature extraction but also incorporates mixed kernel size spatial attention mechanisms to better focus on local features. We have also integrated YOCO data augmentation techniques to simulate complex imaging conditions, enhancing the model’s robustness and accuracy. The effectiveness of these innovations has been validated through experiments on the KinFaceW-I, KinFaceW-II, and synthesized Syn-KinFaceW-I datasets, achieving accuracy rates of 82.7%, 94.1%, and 83.2% respectively. These results significantly surpass both traditional models and current advanced models.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":null,"pages":null},"PeriodicalIF":5.5000,"publicationDate":"2024-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224015212","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

In the field of kinship verification, facial recognition technology is becoming increasingly vital due to privacy concerns, ethical disputes, and the high costs associated with DNA testing. We have developed a novel method, the AutoSyn framework, to synthesize facial images and enhance kinship image datasets, effectively addressing the challenges of scale and quality in existing datasets. By employing a strategy that mixes ages and genders in the synthesized images, we minimize the impact of these factors on kinship recognition tasks. We have enhanced the original KinFaceW-I dataset by integrating ten distinct styles, including diverse combinations of gender, ethnicity, and age. This enrichment significantly improves both the quality and quantity of the images. Furthermore, this paper introduces an efficient feature extractor for kinship tasks, KinFace-CSFE, within a siamese neural network framework. This model not only utilizes meticulously designed channel feature extraction but also incorporates mixed kernel size spatial attention mechanisms to better focus on local features. We have also integrated YOCO data augmentation techniques to simulate complex imaging conditions, enhancing the model’s robustness and accuracy. The effectiveness of these innovations has been validated through experiments on the KinFaceW-I, KinFaceW-II, and synthesized Syn-KinFaceW-I datasets, achieving accuracy rates of 82.7%, 94.1%, and 83.2% respectively. These results significantly surpass both traditional models and current advanced models.
用于亲属关系识别的多属性均衡数据集生成框架 AutoSyn 和 KinFace 通道空间特征提取器
在亲属关系验证领域,由于隐私问题、伦理争议以及 DNA 检测的高昂成本,面部识别技术正变得越来越重要。我们开发了一种新方法--AutoSyn 框架,用于合成面部图像和增强亲属关系图像数据集,有效解决了现有数据集在规模和质量方面的难题。通过采用在合成图像中混合年龄和性别的策略,我们最大限度地减少了这些因素对亲属关系识别任务的影响。我们通过整合十种不同的风格,包括性别、种族和年龄的不同组合,增强了原始 KinFaceW-I 数据集。这种丰富性大大提高了图像的质量和数量。此外,本文还在连体神经网络框架内介绍了一种用于亲缘关系任务的高效特征提取器 KinFace-CSFE。该模型不仅利用了精心设计的通道特征提取,还结合了混合核大小的空间关注机制,以更好地关注局部特征。我们还集成了 YOCO 数据增强技术,以模拟复杂的成像条件,从而提高模型的鲁棒性和准确性。通过在 KinFaceW-I、KinFaceW-II 和合成 Syn-KinFaceW-I 数据集上的实验,这些创新的有效性得到了验证,准确率分别达到了 82.7%、94.1% 和 83.2%。这些结果大大超过了传统模型和当前的先进模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信