Research on Intelligent Recognition Algorithm of College Students’ Classroom Behavior Based on Improved SSD

Lv Wenchao, Huan Meng, Zhang Yuping, Liu Shuai
{"title":"Research on Intelligent Recognition Algorithm of College Students’ Classroom Behavior Based on Improved SSD","authors":"Lv Wenchao, Huan Meng, Zhang Yuping, Liu Shuai","doi":"10.1109/CCAI55564.2022.9807756","DOIUrl":null,"url":null,"abstract":"This paper takes the classroom images of more than 50 classrooms in a university for nearly 4 months in a semester as the research object. The LabelImg manual annotation method is used to construct a detection data set including four behavioral states: listening to class, taking notes, playing with mobile phones, and sleeping. In order to effectively improve the detection accuracy of the data annotation model, we used data enhancement techniques such as cropping, rotation, and shading transformation to expand the number of dataset. Based on this dataset, an improved SSD model based on deep learning target detection technology is adopted. ResNet module is used to solve the problem that VGG module has poor detection results of students’ behavior state in picture analysis, FPN module is added to build RF-SSD detection model to improve the efficiency of image recognition to solve the problem of the low efficiency of small target recognition in the back of class. The experimental results show that RF-SSD has a great improvement in feature extraction ability and small target recognition accuracy compared with native SSD in self-constructed dataset, and can provide technical support and new ideas and methods for teaching management in universities.","PeriodicalId":340195,"journal":{"name":"2022 IEEE 2nd International Conference on Computer Communication and Artificial Intelligence (CCAI)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 2nd International Conference on Computer Communication and Artificial Intelligence (CCAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCAI55564.2022.9807756","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

This paper takes the classroom images of more than 50 classrooms in a university for nearly 4 months in a semester as the research object. The LabelImg manual annotation method is used to construct a detection data set including four behavioral states: listening to class, taking notes, playing with mobile phones, and sleeping. In order to effectively improve the detection accuracy of the data annotation model, we used data enhancement techniques such as cropping, rotation, and shading transformation to expand the number of dataset. Based on this dataset, an improved SSD model based on deep learning target detection technology is adopted. ResNet module is used to solve the problem that VGG module has poor detection results of students’ behavior state in picture analysis, FPN module is added to build RF-SSD detection model to improve the efficiency of image recognition to solve the problem of the low efficiency of small target recognition in the back of class. The experimental results show that RF-SSD has a great improvement in feature extraction ability and small target recognition accuracy compared with native SSD in self-constructed dataset, and can provide technical support and new ideas and methods for teaching management in universities.
基于改进SSD的大学生课堂行为智能识别算法研究
本文以某高校一学期近4个月的50多个教室的课堂影像为研究对象。使用LabelImg手工标注方法构建了一个包含听课、记笔记、玩手机、睡觉四种行为状态的检测数据集。为了有效提高数据标注模型的检测精度,我们使用了裁剪、旋转、阴影变换等数据增强技术来扩展数据集的数量。在此基础上,采用了一种基于深度学习目标检测技术的改进SSD模型。利用ResNet模块解决了VGG模块在图片分析中对学生行为状态检测结果不佳的问题,加入FPN模块构建RF-SSD检测模型提高图像识别效率,解决了课堂后面小目标识别效率低的问题。实验结果表明,在自建数据集上,RF-SSD在特征提取能力和小目标识别精度上均较原生SSD有较大提升,可为高校教学管理提供技术支持和新思路、新方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信