Lightweight Convolutional Neural Network-Based Computer Vision Model for Human Behavior Analysis on Consumer Internet of Things Devices

IF 10.9 2区 计算机科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Mohamed Elhoseny;E. Laxmi Lydia;S. Rama Sree;Elvir Akhmetshin;K. Shankar
{"title":"Lightweight Convolutional Neural Network-Based Computer Vision Model for Human Behavior Analysis on Consumer Internet of Things Devices","authors":"Mohamed Elhoseny;E. Laxmi Lydia;S. Rama Sree;Elvir Akhmetshin;K. Shankar","doi":"10.1109/TCE.2025.3564127","DOIUrl":null,"url":null,"abstract":"The rapid advancements of technology have encouraged the growth of the Internet of Things (IoT), which has transformed how individuals interact with their environments. Among its many branches, Consumer IoT (CIoT) has emerged as a leading force by integrating IoT elements into everyday devices, enhancing user experiences, and offering intelligent services. In particular, smart home environments powered by CIoT devices are improving the quality of life, specifically for the elderly and individuals with disabilities, through automation and behaviour monitoring. To efficiently analyze human behaviour in such settings, this study proposes a novel lightweight computer vision technique, LCNNCV-HBA (Lightweight Convolutional Neural Network-Based Computer Vision for Human Behavior Analysis), specifically optimized for resource-constrained CIoT devices. The proposed method begins with Median Filtering (MF) to eliminate noise, followed by ConvNeXtTiny, a compact yet effective deep learning architecture used for feature extraction by capturing key spatial patterns from images with minimal resource consumption. For behaviour classification, a stacked denoising autoencoder (SDAE) is employed, while an Improved Sparrow Search Algorithm (ISSA) is used to fine-tune hyperparameters and enhance model performance. Experimental validation conducted on a benchmark image dataset demonstrates the effectiveness of the proposed LCNNCV-HBA approach, achieving a superior accuracy of 98.56%, outperforming existing methods in both efficiency and precision.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"71 2","pages":"5645-5652"},"PeriodicalIF":10.9000,"publicationDate":"2025-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10980367/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

The rapid advancements of technology have encouraged the growth of the Internet of Things (IoT), which has transformed how individuals interact with their environments. Among its many branches, Consumer IoT (CIoT) has emerged as a leading force by integrating IoT elements into everyday devices, enhancing user experiences, and offering intelligent services. In particular, smart home environments powered by CIoT devices are improving the quality of life, specifically for the elderly and individuals with disabilities, through automation and behaviour monitoring. To efficiently analyze human behaviour in such settings, this study proposes a novel lightweight computer vision technique, LCNNCV-HBA (Lightweight Convolutional Neural Network-Based Computer Vision for Human Behavior Analysis), specifically optimized for resource-constrained CIoT devices. The proposed method begins with Median Filtering (MF) to eliminate noise, followed by ConvNeXtTiny, a compact yet effective deep learning architecture used for feature extraction by capturing key spatial patterns from images with minimal resource consumption. For behaviour classification, a stacked denoising autoencoder (SDAE) is employed, while an Improved Sparrow Search Algorithm (ISSA) is used to fine-tune hyperparameters and enhance model performance. Experimental validation conducted on a benchmark image dataset demonstrates the effectiveness of the proposed LCNNCV-HBA approach, achieving a superior accuracy of 98.56%, outperforming existing methods in both efficiency and precision.
基于轻量级卷积神经网络的消费类物联网设备人类行为分析计算机视觉模型
技术的快速进步促进了物联网(IoT)的发展,它改变了个人与环境的互动方式。在其众多分支中,消费物联网(CIoT)通过将物联网元素集成到日常设备中,增强用户体验并提供智能服务,已成为主导力量。特别是,由物联网设备驱动的智能家居环境正在通过自动化和行为监控改善生活质量,特别是老年人和残疾人。为了有效地分析这种环境下的人类行为,本研究提出了一种新的轻量级计算机视觉技术,LCNNCV-HBA(基于轻量级卷积神经网络的人类行为分析计算机视觉),专门针对资源受限的CIoT设备进行了优化。所提出的方法首先使用中值滤波(MF)来消除噪声,然后是ConvNeXtTiny,这是一种紧凑而有效的深度学习架构,用于通过以最小的资源消耗从图像中捕获关键空间模式来提取特征。在行为分类方面,采用层叠去噪自编码器(SDAE),改进的麻雀搜索算法(ISSA)对超参数进行微调,提高模型性能。在一个基准图像数据集上进行的实验验证证明了LCNNCV-HBA方法的有效性,准确率达到了98.56%,在效率和精度上都优于现有方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.70
自引率
9.30%
发文量
59
审稿时长
3.3 months
期刊介绍: The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信