FAS-MBCA:基于多路径双向交叉注意融合的人脸防欺骗技术

IF 4.4
Dhimas Arief Dharmawan;Made Vidyatma Adhi Krisna;Anto Satriyo Nugroho;Andrey Ferriyan;Bambang Yuwono;Jaconiah Widiwasita;Aqsha Jauzaarafa' Setya Hadi
{"title":"FAS-MBCA:基于多路径双向交叉注意融合的人脸防欺骗技术","authors":"Dhimas Arief Dharmawan;Made Vidyatma Adhi Krisna;Anto Satriyo Nugroho;Andrey Ferriyan;Bambang Yuwono;Jaconiah Widiwasita;Aqsha Jauzaarafa' Setya Hadi","doi":"10.1109/TBIOM.2026.3692509","DOIUrl":null,"url":null,"abstract":"Face Anti-Spoofing (FAS) is a critical component for securing face recognition systems against diverse presentation attacks. multi-modal FAS approaches leverage complementary cues from multiple sensors; however, existing methods often adopt single-path fusion or unidirectional interaction schemes, which may introduce modality hierarchy and limit comprehensive cross-modal feature refinement. In this paper, we propose FAS-MBCA, a structured multi-path bi-directional cross-attention framework for tri-modal face anti-spoofing. FAS-MBCA explicitly constructs a complete pairwise interaction topology among RGB, depth, and infrared modalities, enabling reciprocal feature-map refinement across all modality pairs. By modeling six-direction cross-modal interactions within a lightweight CNN-based architecture, the proposed framework enhances multi-modal synergy while maintaining computational efficiency. We evaluate FAS-MBCA on multiple widely used benchmarks, including CASIA-SURF (MmFA), CASIA-CeFA, and WMCA, under both intra-dataset and cross-dataset protocols. Extensive experiments demonstrate that FAS-MBCA consistently outperforms single-modal baselines and naïve fusion strategies, and achieves competitive or superior performance compared to recent multi-modal methods. Efficiency analysis in terms of model parameters and GFLOPs further indicates a favorable accuracy–efficiency trade-off. These results validate that explicitly modeling complete bi-directional cross-modal interaction at the feature-map level provides an effective and practical solution for multi-modal face anti-spoofing. The source code of FAS-MBCA is publicly available at <uri>https://github.com/nascafas2025/FAS-MBCA</uri>","PeriodicalId":73307,"journal":{"name":"IEEE transactions on biometrics, behavior, and identity science","volume":"8 5","pages":"947-959"},"PeriodicalIF":4.4000,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"FAS-MBCA: Face Anti-Spoofing Using Multi-Path Bi-Directional Cross-Attention Fusion\",\"authors\":\"Dhimas Arief Dharmawan;Made Vidyatma Adhi Krisna;Anto Satriyo Nugroho;Andrey Ferriyan;Bambang Yuwono;Jaconiah Widiwasita;Aqsha Jauzaarafa' Setya Hadi\",\"doi\":\"10.1109/TBIOM.2026.3692509\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Face Anti-Spoofing (FAS) is a critical component for securing face recognition systems against diverse presentation attacks. multi-modal FAS approaches leverage complementary cues from multiple sensors; however, existing methods often adopt single-path fusion or unidirectional interaction schemes, which may introduce modality hierarchy and limit comprehensive cross-modal feature refinement. In this paper, we propose FAS-MBCA, a structured multi-path bi-directional cross-attention framework for tri-modal face anti-spoofing. FAS-MBCA explicitly constructs a complete pairwise interaction topology among RGB, depth, and infrared modalities, enabling reciprocal feature-map refinement across all modality pairs. By modeling six-direction cross-modal interactions within a lightweight CNN-based architecture, the proposed framework enhances multi-modal synergy while maintaining computational efficiency. We evaluate FAS-MBCA on multiple widely used benchmarks, including CASIA-SURF (MmFA), CASIA-CeFA, and WMCA, under both intra-dataset and cross-dataset protocols. Extensive experiments demonstrate that FAS-MBCA consistently outperforms single-modal baselines and naïve fusion strategies, and achieves competitive or superior performance compared to recent multi-modal methods. Efficiency analysis in terms of model parameters and GFLOPs further indicates a favorable accuracy–efficiency trade-off. These results validate that explicitly modeling complete bi-directional cross-modal interaction at the feature-map level provides an effective and practical solution for multi-modal face anti-spoofing. The source code of FAS-MBCA is publicly available at <uri>https://github.com/nascafas2025/FAS-MBCA</uri>\",\"PeriodicalId\":73307,\"journal\":{\"name\":\"IEEE transactions on biometrics, behavior, and identity science\",\"volume\":\"8 5\",\"pages\":\"947-959\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2026-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on biometrics, behavior, and identity science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11516204/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/3/12 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biometrics, behavior, and identity science","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11516204/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/12 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

人脸反欺骗(FAS)是保护人脸识别系统免受各种表示攻击的关键组成部分。多模态FAS方法利用来自多个传感器的互补线索;然而,现有的方法往往采用单路径融合或单向交互方案,这可能会引入模态层次,限制了全面的跨模态特征提取。本文提出了一种用于三模态人脸防欺骗的结构化多路径双向交叉注意框架FAS-MBCA。FAS-MBCA明确地在RGB、深度和红外模态之间构建了一个完整的成对交互拓扑结构,实现了所有模态对的互反特征映射优化。通过在基于cnn的轻量级架构中建模六方向跨模态交互,所提出的框架在保持计算效率的同时增强了多模态协同。我们在多个广泛使用的基准上评估了FAS-MBCA,包括CASIA-SURF (MmFA), CASIA-CeFA和WMCA,在数据集内和跨数据集协议下。大量实验表明,FAS-MBCA始终优于单模态基线和naïve融合策略,与最近的多模态方法相比,具有竞争力或更高的性能。基于模型参数和GFLOPs的效率分析进一步表明了良好的精度-效率权衡。这些结果验证了在特征图级别上明确建模完整的双向跨模态交互为多模态人脸防欺骗提供了有效和实用的解决方案。FAS-MBCA的源代码可在https://github.com/nascafas2025/FAS-MBCA上公开获得
本文章由计算机程序翻译,如有差异,请以英文原文为准。
FAS-MBCA: Face Anti-Spoofing Using Multi-Path Bi-Directional Cross-Attention Fusion
Face Anti-Spoofing (FAS) is a critical component for securing face recognition systems against diverse presentation attacks. multi-modal FAS approaches leverage complementary cues from multiple sensors; however, existing methods often adopt single-path fusion or unidirectional interaction schemes, which may introduce modality hierarchy and limit comprehensive cross-modal feature refinement. In this paper, we propose FAS-MBCA, a structured multi-path bi-directional cross-attention framework for tri-modal face anti-spoofing. FAS-MBCA explicitly constructs a complete pairwise interaction topology among RGB, depth, and infrared modalities, enabling reciprocal feature-map refinement across all modality pairs. By modeling six-direction cross-modal interactions within a lightweight CNN-based architecture, the proposed framework enhances multi-modal synergy while maintaining computational efficiency. We evaluate FAS-MBCA on multiple widely used benchmarks, including CASIA-SURF (MmFA), CASIA-CeFA, and WMCA, under both intra-dataset and cross-dataset protocols. Extensive experiments demonstrate that FAS-MBCA consistently outperforms single-modal baselines and naïve fusion strategies, and achieves competitive or superior performance compared to recent multi-modal methods. Efficiency analysis in terms of model parameters and GFLOPs further indicates a favorable accuracy–efficiency trade-off. These results validate that explicitly modeling complete bi-directional cross-modal interaction at the feature-map level provides an effective and practical solution for multi-modal face anti-spoofing. The source code of FAS-MBCA is publicly available at https://github.com/nascafas2025/FAS-MBCA
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.90
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书