学生课堂行为识别的有效模式

Hongye Zhu, Jinhua Zhao, L. Niu
{"title":"学生课堂行为识别的有效模式","authors":"Hongye Zhu, Jinhua Zhao, L. Niu","doi":"10.1109/IEIR56323.2022.10050077","DOIUrl":null,"url":null,"abstract":"AI and big data analysis for student classroom behavior recognition can be used as auxiliary means to improve teaching quality. Recognition in classroom scenarios suffers from issues such as tiny targets and complex environmental interference. To tackle these problems, an efficient model based on YOLOv4-tiny is proposed in this paper. Specifically, we design a new module named ResBlock-S to reduce the floating point operations (FLOPs) of the model to improve the speed. Then, the introduction of the Convolutional Block Attention Module (CBAM) mechanism to obtain extra local information of images during the training process, which can ensure the recognition accuracy. As most available public datasets are not applicable to this work, we construct a classroom behavior dataset. Experiments were conducted on the public dataset and our self-built dataset to verify the performance of our model in general scenarios and classroom scenarios, respectively. Compared with YOLOv4-tiny and other lightweight CNN models such as MobileNetv2, MobileNetv3 and ShuffleNetv2, the mean Average Precision (mAP) of our approach on the self-built dataset is higher and up to 89.9%. Additionally, the detection speed of our approach is faster than the aforementioned methods, which is up to 167 fps.","PeriodicalId":183709,"journal":{"name":"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"An Efficient Model For Student Behavior Recognition in Classroom\",\"authors\":\"Hongye Zhu, Jinhua Zhao, L. Niu\",\"doi\":\"10.1109/IEIR56323.2022.10050077\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"AI and big data analysis for student classroom behavior recognition can be used as auxiliary means to improve teaching quality. Recognition in classroom scenarios suffers from issues such as tiny targets and complex environmental interference. To tackle these problems, an efficient model based on YOLOv4-tiny is proposed in this paper. Specifically, we design a new module named ResBlock-S to reduce the floating point operations (FLOPs) of the model to improve the speed. Then, the introduction of the Convolutional Block Attention Module (CBAM) mechanism to obtain extra local information of images during the training process, which can ensure the recognition accuracy. As most available public datasets are not applicable to this work, we construct a classroom behavior dataset. Experiments were conducted on the public dataset and our self-built dataset to verify the performance of our model in general scenarios and classroom scenarios, respectively. Compared with YOLOv4-tiny and other lightweight CNN models such as MobileNetv2, MobileNetv3 and ShuffleNetv2, the mean Average Precision (mAP) of our approach on the self-built dataset is higher and up to 89.9%. Additionally, the detection speed of our approach is faster than the aforementioned methods, which is up to 167 fps.\",\"PeriodicalId\":183709,\"journal\":{\"name\":\"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IEIR56323.2022.10050077\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Intelligent Education and Intelligent Research (IEIR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IEIR56323.2022.10050077","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

人工智能和大数据分析对学生课堂行为的识别可以作为提高教学质量的辅助手段。课堂场景中的识别存在目标微小、环境干扰复杂等问题。针对这些问题,本文提出了一种基于YOLOv4-tiny的高效模型。具体而言,我们设计了一个名为ResBlock-S的新模块,以减少模型的浮点运算(FLOPs),从而提高速度。然后,引入卷积块注意模块(CBAM)机制,在训练过程中获取图像的额外局部信息,保证识别的准确性;由于大多数可用的公共数据集不适用于这项工作,我们构建了一个课堂行为数据集。在公共数据集和自建数据集上分别进行了实验,验证了我们的模型在一般场景和课堂场景下的性能。与YOLOv4-tiny和其他轻量级CNN模型(如MobileNetv2、MobileNetv3和ShuffleNetv2)相比,我们的方法在自建数据集上的平均平均精度(mAP)更高,达到89.9%。此外,我们的方法的检测速度比前面提到的方法更快,高达167 fps。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An Efficient Model For Student Behavior Recognition in Classroom
AI and big data analysis for student classroom behavior recognition can be used as auxiliary means to improve teaching quality. Recognition in classroom scenarios suffers from issues such as tiny targets and complex environmental interference. To tackle these problems, an efficient model based on YOLOv4-tiny is proposed in this paper. Specifically, we design a new module named ResBlock-S to reduce the floating point operations (FLOPs) of the model to improve the speed. Then, the introduction of the Convolutional Block Attention Module (CBAM) mechanism to obtain extra local information of images during the training process, which can ensure the recognition accuracy. As most available public datasets are not applicable to this work, we construct a classroom behavior dataset. Experiments were conducted on the public dataset and our self-built dataset to verify the performance of our model in general scenarios and classroom scenarios, respectively. Compared with YOLOv4-tiny and other lightweight CNN models such as MobileNetv2, MobileNetv3 and ShuffleNetv2, the mean Average Precision (mAP) of our approach on the self-built dataset is higher and up to 89.9%. Additionally, the detection speed of our approach is faster than the aforementioned methods, which is up to 167 fps.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信