Real-Time Recognition of the User's Arm Gestures in 2D Space with a Smart Camera

IF 1.6 4区工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC

IEEE Instrumentation & Measurement Magazine Pub Date : 2024-05-01 DOI:10.1109/MIM.2024.10505187

Naji Guedri, Rached Gharbi

{"title":"Real-Time Recognition of the User's Arm Gestures in 2D Space with a Smart Camera","authors":"Naji Guedri, Rached Gharbi","doi":"10.1109/MIM.2024.10505187","DOIUrl":null,"url":null,"abstract":"Gesture control technology is one of the most important technologies introduced today to facilitate human-machine communication. In this article, we propose a Smart Camera One (SCO) to remotely monitor a user's arm movements in order to control a machine. Therefore, its main role is to act as an intermediary between the user and the machine to facilitate communication. This instrument technology can measure and control the different arm positions in real-time with an accuracy of up to 81.5%. The technique consists of learning to perform live tasks. SCO is able to immediately execute a user's task without going through the machine learning phase through demonstrations. During the time of the test, the setup of the demonstrator is done visually by SCO, it can recognize users according to their skin color and distinguish them from colorful backgrounds. This is based on image processing using an intelligent algorithm implemented in the SCO through the Python programming languages and the OpenCV library as described in this article. Although initially a specialized application, SCO could be important in several areas, from remote control of mobile robots to gaming, education, and even marketing. Extensive experiments demonstrate the effectiveness of the developed model as shown in [1].","PeriodicalId":55025,"journal":{"name":"IEEE Instrumentation & Measurement Magazine","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Instrumentation & Measurement Magazine","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1109/MIM.2024.10505187","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}

引用次数: 0

Abstract

Gesture control technology is one of the most important technologies introduced today to facilitate human-machine communication. In this article, we propose a Smart Camera One (SCO) to remotely monitor a user's arm movements in order to control a machine. Therefore, its main role is to act as an intermediary between the user and the machine to facilitate communication. This instrument technology can measure and control the different arm positions in real-time with an accuracy of up to 81.5%. The technique consists of learning to perform live tasks. SCO is able to immediately execute a user's task without going through the machine learning phase through demonstrations. During the time of the test, the setup of the demonstrator is done visually by SCO, it can recognize users according to their skin color and distinguish them from colorful backgrounds. This is based on image processing using an intelligent algorithm implemented in the SCO through the Python programming languages and the OpenCV library as described in this article. Although initially a specialized application, SCO could be important in several areas, from remote control of mobile robots to gaming, education, and even marketing. Extensive experiments demonstrate the effectiveness of the developed model as shown in [1].

查看原文本刊更多论文

利用智能摄像头在二维空间实时识别用户的手臂手势

手势控制技术是当今促进人机交流的最重要技术之一。在本文中，我们提出了一种智能相机一号（SCO），用于远程监控用户的手臂动作，从而控制机器。因此，它的主要作用是充当用户和机器之间的中介，促进交流。这项仪器技术可以实时测量和控制手臂的不同位置，精确度高达 81.5%。该技术包括学习执行实时任务。SCO 能够立即执行用户的任务，而无需通过演示进入机器学习阶段。在测试期间，SCO 通过视觉方式完成演示器的设置，它可以根据用户的肤色识别用户，并将他们从五颜六色的背景中区分出来。如本文所述，这是基于 SCO 通过 Python 编程语言和 OpenCV 库实现的智能算法进行的图像处理。虽然 SCO 最初只是一种专业应用，但它在多个领域都具有重要意义，从远程控制移动机器人到游戏、教育甚至营销。如 [1] 所示，大量实验证明了所开发模型的有效性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

IEEE Instrumentation & Measurement Magazine 工程技术-工程：电子与电气

CiteScore

4.20

自引率

4.80%

发文量

147

审稿时长

>12 weeks

期刊介绍： IEEE Instrumentation & Measurement Magazine is a bimonthly publication. It publishes in February, April, June, August, October, and December of each year. The magazine covers a wide variety of topics in instrumentation, measurement, and systems that measure or instrument equipment or other systems. The magazine has the goal of providing readable introductions and overviews of technology in instrumentation and measurement to a wide engineering audience. It does this through articles, tutorials, columns, and departments. Its goal is to cross disciplines to encourage further research and development in instrumentation and measurement.