Multimodal Biometrics: A Review of Handcrafted and AI–Based Fusion Approaches

IF 1.6 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Hind Es-Sobbahi, Mohamed Radouane, Khalid Nafil
{"title":"Multimodal Biometrics: A Review of Handcrafted and AI–Based Fusion Approaches","authors":"Hind Es-Sobbahi,&nbsp;Mohamed Radouane,&nbsp;Khalid Nafil","doi":"10.1049/bme2/5055434","DOIUrl":null,"url":null,"abstract":"<p>As security threats continue to evolve, multimodal biometric recognition systems (MBRSs) have emerged as robust solutions for reliable user authentication. To the best of our knowledge, this study presents the first systematic literature review (SLR) specifically focused on MBRS based on physiological traits, combining traditional image processing techniques (e.g., Gabor filters and edge detection) with artificial intelligence (AI) methods. These include machine learning (ML) approaches (e.g., Softmax classifier and linear discriminant analysis), deep learning (DL) models (e.g., convolutional neural networks [CNNs]), and metaheuristic optimization algorithms (e.g., firefly algorithm, gray wolf optimizer [GWO], and GwPeSOA). We analyze and compare the frequency and effectiveness of various fusion levels (sensor, feature, score, and decision) employed in the literature. Our review synthesizes findings from 29 peer-reviewed studies, highlights commonly used biometric traits and databases (e.g., CASIA and IITD), and categorizes the fusion techniques applied at each stage of the biometric pipeline, from preprocessing and feature extraction to decision-making. Results show that score-level fusion remains the most widely adopted approach. Multimodal systems combining multiple physiological traits (e.g., face, iris, and finger vein) demonstrate significant performance gains, with some studies reporting accuracies reaching 100%. Importantly, no prior review has provided such an integrative perspective combining handcrafted techniques with diverse AI–based approaches across multiple fusion levels. This comprehensive synthesis is intended to guide future research toward more practical, scalable, and accurate multimodal biometric systems.</p>","PeriodicalId":48821,"journal":{"name":"IET Biometrics","volume":"2025 1","pages":""},"PeriodicalIF":1.6000,"publicationDate":"2025-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/bme2/5055434","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Biometrics","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/bme2/5055434","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

As security threats continue to evolve, multimodal biometric recognition systems (MBRSs) have emerged as robust solutions for reliable user authentication. To the best of our knowledge, this study presents the first systematic literature review (SLR) specifically focused on MBRS based on physiological traits, combining traditional image processing techniques (e.g., Gabor filters and edge detection) with artificial intelligence (AI) methods. These include machine learning (ML) approaches (e.g., Softmax classifier and linear discriminant analysis), deep learning (DL) models (e.g., convolutional neural networks [CNNs]), and metaheuristic optimization algorithms (e.g., firefly algorithm, gray wolf optimizer [GWO], and GwPeSOA). We analyze and compare the frequency and effectiveness of various fusion levels (sensor, feature, score, and decision) employed in the literature. Our review synthesizes findings from 29 peer-reviewed studies, highlights commonly used biometric traits and databases (e.g., CASIA and IITD), and categorizes the fusion techniques applied at each stage of the biometric pipeline, from preprocessing and feature extraction to decision-making. Results show that score-level fusion remains the most widely adopted approach. Multimodal systems combining multiple physiological traits (e.g., face, iris, and finger vein) demonstrate significant performance gains, with some studies reporting accuracies reaching 100%. Importantly, no prior review has provided such an integrative perspective combining handcrafted techniques with diverse AI–based approaches across multiple fusion levels. This comprehensive synthesis is intended to guide future research toward more practical, scalable, and accurate multimodal biometric systems.

Abstract Image

Abstract Image

Abstract Image

多模态生物识别:手工和基于人工智能的融合方法综述
随着安全威胁的不断发展,多模态生物识别系统(MBRSs)已经成为可靠用户身份验证的强大解决方案。据我们所知,本研究首次针对基于生理特征的MBRS进行了系统的文献综述(SLR),将传统的图像处理技术(如Gabor滤波器和边缘检测)与人工智能(AI)方法相结合。这些包括机器学习(ML)方法(例如,Softmax分类器和线性判别分析),深度学习(DL)模型(例如,卷积神经网络[cnn])和元启发式优化算法(例如,萤火虫算法,灰狼优化器[GWO]和GwPeSOA)。我们分析和比较了文献中使用的各种融合水平(传感器、特征、评分和决策)的频率和有效性。我们的综述综合了29项同行评议的研究结果,重点介绍了常用的生物特征特征和数据库(如CASIA和IITD),并对生物特征管道各个阶段应用的融合技术进行了分类,从预处理、特征提取到决策。结果表明,分数级融合仍然是最广泛采用的方法。结合多种生理特征(如面部、虹膜和手指静脉)的多模态系统显示出显著的性能提升,一些研究报告准确率达到100%。重要的是,没有先前的综述提供了这样的综合视角,将手工制作的技术与跨多个融合水平的各种基于人工智能的方法相结合。这一全面的综合旨在指导未来的研究走向更实用、可扩展和准确的多模态生物识别系统。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Biometrics
IET Biometrics COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-
CiteScore
5.90
自引率
0.00%
发文量
46
审稿时长
33 weeks
期刊介绍: The field of biometric recognition - automated recognition of individuals based on their behavioural and biological characteristics - has now reached a level of maturity where viable practical applications are both possible and increasingly available. The biometrics field is characterised especially by its interdisciplinarity since, while focused primarily around a strong technological base, effective system design and implementation often requires a broad range of skills encompassing, for example, human factors, data security and database technologies, psychological and physiological awareness, and so on. Also, the technology focus itself embraces diversity, since the engineering of effective biometric systems requires integration of image analysis, pattern recognition, sensor technology, database engineering, security design and many other strands of understanding. The scope of the journal is intentionally relatively wide. While focusing on core technological issues, it is recognised that these may be inherently diverse and in many cases may cross traditional disciplinary boundaries. The scope of the journal will therefore include any topics where it can be shown that a paper can increase our understanding of biometric systems, signal future developments and applications for biometrics, or promote greater practical uptake for relevant technologies: Development and enhancement of individual biometric modalities including the established and traditional modalities (e.g. face, fingerprint, iris, signature and handwriting recognition) and also newer or emerging modalities (gait, ear-shape, neurological patterns, etc.) Multibiometrics, theoretical and practical issues, implementation of practical systems, multiclassifier and multimodal approaches Soft biometrics and information fusion for identification, verification and trait prediction Human factors and the human-computer interface issues for biometric systems, exception handling strategies Template construction and template management, ageing factors and their impact on biometric systems Usability and user-oriented design, psychological and physiological principles and system integration Sensors and sensor technologies for biometric processing Database technologies to support biometric systems Implementation of biometric systems, security engineering implications, smartcard and associated technologies in implementation, implementation platforms, system design and performance evaluation Trust and privacy issues, security of biometric systems and supporting technological solutions, biometric template protection Biometric cryptosystems, security and biometrics-linked encryption Links with forensic processing and cross-disciplinary commonalities Core underpinning technologies (e.g. image analysis, pattern recognition, computer vision, signal processing, etc.), where the specific relevance to biometric processing can be demonstrated Applications and application-led considerations Position papers on technology or on the industrial context of biometric system development Adoption and promotion of standards in biometrics, improving technology acceptance, deployment and interoperability, avoiding cross-cultural and cross-sector restrictions Relevant ethical and social issues
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书