Artificial Intelligence-Oriented User Interface Design and Human Behavior Recognition based on Human–Computer Nature Interaction

IF 0.9 4区 计算机科学 Q4 ROBOTICS
Xiaolan Han, Dong Huang, Sang Eun-Lee, Jong Hoon-Yang
{"title":"Artificial Intelligence-Oriented User Interface Design and Human Behavior Recognition based on Human–Computer Nature Interaction","authors":"Xiaolan Han, Dong Huang, Sang Eun-Lee, Jong Hoon-Yang","doi":"10.1142/s0219843622500207","DOIUrl":null,"url":null,"abstract":"This work is to explore the application of intelligent algorithms based on deep learning in human–computer interaction systems, hoping to promote the development of human–computer interaction systems in the field of behavior recognition. Firstly, the design scheme of the human–computer interaction system is presented, and the establishment of the robot visual positioning system is emphasized. Then, the fast-region convolutional neural networks (fast-RCNN) algorithm is introduced, and it is combined with deep convolutional residual network (ResNet101). A candidate region extraction algorithm based on ResNet and long short-term memory network is proposed, and a residual network (ResNet) for spatial context memory is proposed. Both algorithms are employed in human–computer interaction systems. Finally, the performance of the algorithm and the human–computer interaction system are analyzed and characterized. The results show that the proposed candidate region extraction algorithm can significantly reduce the loss value of training set and test set after training. In addition, the corresponding accuracy, recall, and [Formula: see text]-value of the model are all above 0.98, which proves that the model has a good detection accuracy. Spatial context memory ResNet shows good accuracy in speech expression detection. The detection accuracy of single attribute, double attribute, and multi-attribute speech expression is above 89%, and the detection accuracy is good. In summary, the human–computer interaction system shows good performance in capturing target objects, even for unlabeled objects, the corresponding grasping success rate is 95%. Therefore, this work provides a theoretical basis and reference for the application of intelligent optimization algorithm in human–computer interaction system.","PeriodicalId":50319,"journal":{"name":"International Journal of Humanoid Robotics","volume":null,"pages":null},"PeriodicalIF":0.9000,"publicationDate":"2022-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Humanoid Robotics","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1142/s0219843622500207","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

This work is to explore the application of intelligent algorithms based on deep learning in human–computer interaction systems, hoping to promote the development of human–computer interaction systems in the field of behavior recognition. Firstly, the design scheme of the human–computer interaction system is presented, and the establishment of the robot visual positioning system is emphasized. Then, the fast-region convolutional neural networks (fast-RCNN) algorithm is introduced, and it is combined with deep convolutional residual network (ResNet101). A candidate region extraction algorithm based on ResNet and long short-term memory network is proposed, and a residual network (ResNet) for spatial context memory is proposed. Both algorithms are employed in human–computer interaction systems. Finally, the performance of the algorithm and the human–computer interaction system are analyzed and characterized. The results show that the proposed candidate region extraction algorithm can significantly reduce the loss value of training set and test set after training. In addition, the corresponding accuracy, recall, and [Formula: see text]-value of the model are all above 0.98, which proves that the model has a good detection accuracy. Spatial context memory ResNet shows good accuracy in speech expression detection. The detection accuracy of single attribute, double attribute, and multi-attribute speech expression is above 89%, and the detection accuracy is good. In summary, the human–computer interaction system shows good performance in capturing target objects, even for unlabeled objects, the corresponding grasping success rate is 95%. Therefore, this work provides a theoretical basis and reference for the application of intelligent optimization algorithm in human–computer interaction system.
基于人机交互的面向人工智能的用户界面设计与人类行为识别
本工作旨在探索基于深度学习的智能算法在人机交互系统中的应用,希望能够推动行为识别领域的人机交互系统的发展。首先,给出了人机交互系统的设计方案,重点介绍了机器人视觉定位系统的建立。然后,介绍了快速区域卷积神经网络(fast-RCNN)算法,并将其与深度卷积残差网络(ResNet101)相结合。提出了一种基于ResNet和长短期记忆网络的候选区域提取算法,并提出了一种用于空间上下文记忆的残余网络(ResNet)。这两种算法都应用于人机交互系统中。最后,对算法和人机交互系统的性能进行了分析和表征。结果表明,本文提出的候选区域提取算法能够显著降低训练集和测试集训练后的损失值。此外,该模型对应的准确率、召回率和[公式:见文]-值均在0.98以上,证明该模型具有较好的检测精度。空间上下文记忆ResNet在语音表达检测中表现出较好的准确性。单属性、双属性和多属性语音表达的检测准确率均在89%以上,检测精度较好。综上所述,人机交互系统在捕获目标物体方面表现出良好的性能,即使对于未标记的物体,相应的抓取成功率也达到95%。因此,本工作为智能优化算法在人机交互系统中的应用提供了理论基础和参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Humanoid Robotics
International Journal of Humanoid Robotics 工程技术-机器人学
CiteScore
3.50
自引率
13.30%
发文量
29
审稿时长
6 months
期刊介绍: The International Journal of Humanoid Robotics (IJHR) covers all subjects on the mind and body of humanoid robots. It is dedicated to advancing new theories, new techniques, and new implementations contributing to the successful achievement of future robots which not only imitate human beings, but also serve human beings. While IJHR encourages the contribution of original papers which are solidly grounded on proven theories or experimental procedures, the journal also encourages the contribution of innovative papers which venture into the new, frontier areas in robotics. Such papers need not necessarily demonstrate, in the early stages of research and development, the full potential of new findings on a physical or virtual robot. IJHR welcomes original papers in the following categories: Research papers, which disseminate scientific findings contributing to solving technical issues underlying the development of humanoid robots, or biologically-inspired robots, having multiple functionality related to either physical capabilities (i.e. motion) or mental capabilities (i.e. intelligence) Review articles, which describe, in non-technical terms, the latest in basic theories, principles, and algorithmic solutions Short articles (e.g. feature articles and dialogues), which discuss the latest significant achievements and the future trends in robotics R&D Papers on curriculum development in humanoid robot education Book reviews.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信