{"title":"基于轻量级卷积神经网络的消费类物联网设备人类行为分析计算机视觉模型","authors":"Mohamed Elhoseny;E. Laxmi Lydia;S. Rama Sree;Elvir Akhmetshin;K. Shankar","doi":"10.1109/TCE.2025.3564127","DOIUrl":null,"url":null,"abstract":"The rapid advancements of technology have encouraged the growth of the Internet of Things (IoT), which has transformed how individuals interact with their environments. Among its many branches, Consumer IoT (CIoT) has emerged as a leading force by integrating IoT elements into everyday devices, enhancing user experiences, and offering intelligent services. In particular, smart home environments powered by CIoT devices are improving the quality of life, specifically for the elderly and individuals with disabilities, through automation and behaviour monitoring. To efficiently analyze human behaviour in such settings, this study proposes a novel lightweight computer vision technique, LCNNCV-HBA (Lightweight Convolutional Neural Network-Based Computer Vision for Human Behavior Analysis), specifically optimized for resource-constrained CIoT devices. The proposed method begins with Median Filtering (MF) to eliminate noise, followed by ConvNeXtTiny, a compact yet effective deep learning architecture used for feature extraction by capturing key spatial patterns from images with minimal resource consumption. For behaviour classification, a stacked denoising autoencoder (SDAE) is employed, while an Improved Sparrow Search Algorithm (ISSA) is used to fine-tune hyperparameters and enhance model performance. Experimental validation conducted on a benchmark image dataset demonstrates the effectiveness of the proposed LCNNCV-HBA approach, achieving a superior accuracy of 98.56%, outperforming existing methods in both efficiency and precision.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"71 2","pages":"5645-5652"},"PeriodicalIF":10.9000,"publicationDate":"2025-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Lightweight Convolutional Neural Network-Based Computer Vision Model for Human Behavior Analysis on Consumer Internet of Things Devices\",\"authors\":\"Mohamed Elhoseny;E. Laxmi Lydia;S. Rama Sree;Elvir Akhmetshin;K. Shankar\",\"doi\":\"10.1109/TCE.2025.3564127\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The rapid advancements of technology have encouraged the growth of the Internet of Things (IoT), which has transformed how individuals interact with their environments. Among its many branches, Consumer IoT (CIoT) has emerged as a leading force by integrating IoT elements into everyday devices, enhancing user experiences, and offering intelligent services. In particular, smart home environments powered by CIoT devices are improving the quality of life, specifically for the elderly and individuals with disabilities, through automation and behaviour monitoring. To efficiently analyze human behaviour in such settings, this study proposes a novel lightweight computer vision technique, LCNNCV-HBA (Lightweight Convolutional Neural Network-Based Computer Vision for Human Behavior Analysis), specifically optimized for resource-constrained CIoT devices. The proposed method begins with Median Filtering (MF) to eliminate noise, followed by ConvNeXtTiny, a compact yet effective deep learning architecture used for feature extraction by capturing key spatial patterns from images with minimal resource consumption. For behaviour classification, a stacked denoising autoencoder (SDAE) is employed, while an Improved Sparrow Search Algorithm (ISSA) is used to fine-tune hyperparameters and enhance model performance. Experimental validation conducted on a benchmark image dataset demonstrates the effectiveness of the proposed LCNNCV-HBA approach, achieving a superior accuracy of 98.56%, outperforming existing methods in both efficiency and precision.\",\"PeriodicalId\":13208,\"journal\":{\"name\":\"IEEE Transactions on Consumer Electronics\",\"volume\":\"71 2\",\"pages\":\"5645-5652\"},\"PeriodicalIF\":10.9000,\"publicationDate\":\"2025-04-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Consumer Electronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10980367/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10980367/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Lightweight Convolutional Neural Network-Based Computer Vision Model for Human Behavior Analysis on Consumer Internet of Things Devices
The rapid advancements of technology have encouraged the growth of the Internet of Things (IoT), which has transformed how individuals interact with their environments. Among its many branches, Consumer IoT (CIoT) has emerged as a leading force by integrating IoT elements into everyday devices, enhancing user experiences, and offering intelligent services. In particular, smart home environments powered by CIoT devices are improving the quality of life, specifically for the elderly and individuals with disabilities, through automation and behaviour monitoring. To efficiently analyze human behaviour in such settings, this study proposes a novel lightweight computer vision technique, LCNNCV-HBA (Lightweight Convolutional Neural Network-Based Computer Vision for Human Behavior Analysis), specifically optimized for resource-constrained CIoT devices. The proposed method begins with Median Filtering (MF) to eliminate noise, followed by ConvNeXtTiny, a compact yet effective deep learning architecture used for feature extraction by capturing key spatial patterns from images with minimal resource consumption. For behaviour classification, a stacked denoising autoencoder (SDAE) is employed, while an Improved Sparrow Search Algorithm (ISSA) is used to fine-tune hyperparameters and enhance model performance. Experimental validation conducted on a benchmark image dataset demonstrates the effectiveness of the proposed LCNNCV-HBA approach, achieving a superior accuracy of 98.56%, outperforming existing methods in both efficiency and precision.
期刊介绍:
The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.