基于注意力的嵌入式设备实时精确人脸验证高效轻量级模型

Dongmei Wei, Xingjun Wu, Guoqiang Bai, Linlin Su, Sufen Xu
{"title":"基于注意力的嵌入式设备实时精确人脸验证高效轻量级模型","authors":"Dongmei Wei, Xingjun Wu, Guoqiang Bai, Linlin Su, Sufen Xu","doi":"10.1109/ICCCS52626.2021.9449167","DOIUrl":null,"url":null,"abstract":"With the rapid development of face verification technology, the current face verification has reached a high accuracy rate. However, face verification requires large computing resources and complex model parameters, so it is difficult to be applied in real scenes. The face verification system based on embedded applications can well solve the problems of huge model storage space occupation and high computing resource consumption. The existing mainstream face verification models have reached high accuracy, such as VGG16Net. Although there have been studies trying to design lightweight neural networks, such as MobileFaceNet, etc., there are still shortcomings such as complex structure and high resource consumption, so it is only suitable for mobile devices and other embedded devices, and it is difficult to apply to low power consumption and low performance such as embedded systems. In the device. For embedded systems with limited memory and computing power, a more lightweight neural network model is needed. Therefore, this paper conducts two researches on the problems of model storage requiring a large amount of space and high computational resource consumption. First of all, a lightweight face verification network model MobileFaceNet-v3m based on the attention mechanism is designed to solve the problem of model storage space occupation. Our model has a 15.26% smaller space occupation than MobileFaceNet, which successfully reduces the resource consumption of the model. The accuracy rate can still be maintained at a high level-95.47% of face verification accuracy is achieved on LFW; secondly, We use the learning rate optimization method based on efficient warm restart to train the model, the accuracy of the model is improved faster, and the model is successfully transplanted to the embedded platform, which is another step forward to the real scene application in the future.","PeriodicalId":376290,"journal":{"name":"2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Attention-based Efficient Lightweight Model for Accurate Real-Time Face Verification on Embedded Device\",\"authors\":\"Dongmei Wei, Xingjun Wu, Guoqiang Bai, Linlin Su, Sufen Xu\",\"doi\":\"10.1109/ICCCS52626.2021.9449167\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the rapid development of face verification technology, the current face verification has reached a high accuracy rate. However, face verification requires large computing resources and complex model parameters, so it is difficult to be applied in real scenes. The face verification system based on embedded applications can well solve the problems of huge model storage space occupation and high computing resource consumption. The existing mainstream face verification models have reached high accuracy, such as VGG16Net. Although there have been studies trying to design lightweight neural networks, such as MobileFaceNet, etc., there are still shortcomings such as complex structure and high resource consumption, so it is only suitable for mobile devices and other embedded devices, and it is difficult to apply to low power consumption and low performance such as embedded systems. In the device. For embedded systems with limited memory and computing power, a more lightweight neural network model is needed. Therefore, this paper conducts two researches on the problems of model storage requiring a large amount of space and high computational resource consumption. First of all, a lightweight face verification network model MobileFaceNet-v3m based on the attention mechanism is designed to solve the problem of model storage space occupation. Our model has a 15.26% smaller space occupation than MobileFaceNet, which successfully reduces the resource consumption of the model. The accuracy rate can still be maintained at a high level-95.47% of face verification accuracy is achieved on LFW; secondly, We use the learning rate optimization method based on efficient warm restart to train the model, the accuracy of the model is improved faster, and the model is successfully transplanted to the embedded platform, which is another step forward to the real scene application in the future.\",\"PeriodicalId\":376290,\"journal\":{\"name\":\"2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS)\",\"volume\":\"9 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-04-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCCS52626.2021.9449167\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCCS52626.2021.9449167","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

随着人脸验证技术的快速发展,目前的人脸验证已经达到了很高的准确率。然而,人脸验证需要大量的计算资源和复杂的模型参数,因此难以在真实场景中应用。基于嵌入式应用的人脸验证系统可以很好地解决模型存储空间占用大、计算资源消耗高的问题。现有的主流人脸验证模型已经达到了较高的精度,如VGG16Net。虽然已有尝试设计轻量级神经网络的研究,如MobileFaceNet等,但仍存在结构复杂、资源消耗高等缺点,因此仅适用于移动设备等嵌入式设备,难以应用于嵌入式系统等低功耗、低性能的领域。在设备中。对于内存和计算能力有限的嵌入式系统,需要一种更轻量级的神经网络模型。因此,本文针对模型存储需要大量空间和高计算资源消耗的问题进行了两个方面的研究。首先,设计了基于注意机制的轻量级人脸验证网络模型MobileFaceNet-v3m,解决了模型存储空间占用问题。我们的模型占用的空间比MobileFaceNet小15.26%,成功地降低了模型的资源消耗。准确率仍然保持在较高水平,在LFW上人脸验证准确率达到95.47%;其次,采用基于高效热重启的学习率优化方法对模型进行训练,更快地提高了模型的准确率,并将模型成功移植到嵌入式平台上,向未来的真实场景应用又迈进了一步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Attention-based Efficient Lightweight Model for Accurate Real-Time Face Verification on Embedded Device
With the rapid development of face verification technology, the current face verification has reached a high accuracy rate. However, face verification requires large computing resources and complex model parameters, so it is difficult to be applied in real scenes. The face verification system based on embedded applications can well solve the problems of huge model storage space occupation and high computing resource consumption. The existing mainstream face verification models have reached high accuracy, such as VGG16Net. Although there have been studies trying to design lightweight neural networks, such as MobileFaceNet, etc., there are still shortcomings such as complex structure and high resource consumption, so it is only suitable for mobile devices and other embedded devices, and it is difficult to apply to low power consumption and low performance such as embedded systems. In the device. For embedded systems with limited memory and computing power, a more lightweight neural network model is needed. Therefore, this paper conducts two researches on the problems of model storage requiring a large amount of space and high computational resource consumption. First of all, a lightweight face verification network model MobileFaceNet-v3m based on the attention mechanism is designed to solve the problem of model storage space occupation. Our model has a 15.26% smaller space occupation than MobileFaceNet, which successfully reduces the resource consumption of the model. The accuracy rate can still be maintained at a high level-95.47% of face verification accuracy is achieved on LFW; secondly, We use the learning rate optimization method based on efficient warm restart to train the model, the accuracy of the model is improved faster, and the model is successfully transplanted to the embedded platform, which is another step forward to the real scene application in the future.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信