Lihua Lin, Haodong Yang, Qingchuan Xu, Yannan Xue, Dan Li
{"title":"基于实时检测变换器算法的学生课堂行为检测研究","authors":"Lihua Lin, Haodong Yang, Qingchuan Xu, Yannan Xue, Dan Li","doi":"10.3390/app14146153","DOIUrl":null,"url":null,"abstract":"With the rapid development of artificial intelligence and big data technology, intelligent education systems have become a key research focus in the field of modern educational technology. This study aims to enhance the intelligence level of educational systems by accurately detecting student behavior in the classroom using deep learning techniques. We propose a method for detecting student classroom behavior based on an improved RT DETR (Real-Time Detection Transformer) object detection algorithm. By combining actual classroom observation data with AI-generated data, we create a comprehensive and diverse student behavior dataset (FSCB-dataset). This dataset not only more realistically simulates the classroom environment but also effectively addresses the scarcity of datasets and reduces the cost of dataset construction. The study introduces MobileNetV3 as a lightweight backbone network, reducing the model parameters to one-tenth of the original while maintaining nearly the same accuracy. Additionally, by incorporating learnable position encoding and dynamic upsampling techniques, the model significantly improves its ability to recognize small objects and complex scenes. Test results on the FSCB-dataset show that the improved model achieves significant improvements in real-time performance and computational efficiency. The lightweight network is also easy to deploy on mobile devices, demonstrating its practicality in resource-constrained environments.","PeriodicalId":502388,"journal":{"name":"Applied Sciences","volume":"44 50","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on Student Classroom Behavior Detection Based on the Real-Time Detection Transformer Algorithm\",\"authors\":\"Lihua Lin, Haodong Yang, Qingchuan Xu, Yannan Xue, Dan Li\",\"doi\":\"10.3390/app14146153\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the rapid development of artificial intelligence and big data technology, intelligent education systems have become a key research focus in the field of modern educational technology. This study aims to enhance the intelligence level of educational systems by accurately detecting student behavior in the classroom using deep learning techniques. We propose a method for detecting student classroom behavior based on an improved RT DETR (Real-Time Detection Transformer) object detection algorithm. By combining actual classroom observation data with AI-generated data, we create a comprehensive and diverse student behavior dataset (FSCB-dataset). This dataset not only more realistically simulates the classroom environment but also effectively addresses the scarcity of datasets and reduces the cost of dataset construction. The study introduces MobileNetV3 as a lightweight backbone network, reducing the model parameters to one-tenth of the original while maintaining nearly the same accuracy. Additionally, by incorporating learnable position encoding and dynamic upsampling techniques, the model significantly improves its ability to recognize small objects and complex scenes. Test results on the FSCB-dataset show that the improved model achieves significant improvements in real-time performance and computational efficiency. The lightweight network is also easy to deploy on mobile devices, demonstrating its practicality in resource-constrained environments.\",\"PeriodicalId\":502388,\"journal\":{\"name\":\"Applied Sciences\",\"volume\":\"44 50\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Sciences\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3390/app14146153\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/app14146153","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Research on Student Classroom Behavior Detection Based on the Real-Time Detection Transformer Algorithm
With the rapid development of artificial intelligence and big data technology, intelligent education systems have become a key research focus in the field of modern educational technology. This study aims to enhance the intelligence level of educational systems by accurately detecting student behavior in the classroom using deep learning techniques. We propose a method for detecting student classroom behavior based on an improved RT DETR (Real-Time Detection Transformer) object detection algorithm. By combining actual classroom observation data with AI-generated data, we create a comprehensive and diverse student behavior dataset (FSCB-dataset). This dataset not only more realistically simulates the classroom environment but also effectively addresses the scarcity of datasets and reduces the cost of dataset construction. The study introduces MobileNetV3 as a lightweight backbone network, reducing the model parameters to one-tenth of the original while maintaining nearly the same accuracy. Additionally, by incorporating learnable position encoding and dynamic upsampling techniques, the model significantly improves its ability to recognize small objects and complex scenes. Test results on the FSCB-dataset show that the improved model achieves significant improvements in real-time performance and computational efficiency. The lightweight network is also easy to deploy on mobile devices, demonstrating its practicality in resource-constrained environments.