Sara Ashry;Supratim Das;Mahdie Rafiei;Jan Baumbach;Linda Baumbach
{"title":"基于IMU传感器的人类活动迁移学习研究进展","authors":"Sara Ashry;Supratim Das;Mahdie Rafiei;Jan Baumbach;Linda Baumbach","doi":"10.1109/JSEN.2024.3510097","DOIUrl":null,"url":null,"abstract":"This systematic review comprehensively scrutinizes transfer learning (TL) methods applied to human activity recognition (HAR) using inertial measurement unit (IMU) data. Our objective is to provide a comprehensive resource for researchers and developers by summarizing the existing activities, feature extractions, and TL techniques in the related studies. Moreover, we identify research gaps in these categories, allowing research endeavors to address these gaps in the future. Our methodology follows the structure of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement by formulating precise research questions, establishing search queries, and specifying inclusion and exclusion criteria for study selection. Finally, we extracted and summarized the existing activities, feature extractions, and TL techniques utilized in the included studies. We analyzed 447 studies from PubMed, ACM, and Scopus datasets, of which we ultimately selected 33 pivotal studies that met our inclusion criteria. Overall, we found that TL has enhanced HAR performance by reusing pretrained models. However, it is important to carefully select relevant transfer information to avoid any potential adverse effects. We conclude that there is a lack of studies assessing specific activities, such as personal hygiene and elder care, using IMU sensors and TL. To improve signal representation, a combination of features based on activity nature is important. Aligning algorithms with activity nature is essential—simpler models like AlexNet are suitable for routine activities such as walking, while more complex models like DenseNet are better for intricate tasks like cleaning. Our review is a reference for advancing the understanding of TL’s potential of HAR using IMU data.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 3","pages":"4115-4126"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Transfer Learning of Human Activities Based on IMU Sensors: A Review\",\"authors\":\"Sara Ashry;Supratim Das;Mahdie Rafiei;Jan Baumbach;Linda Baumbach\",\"doi\":\"10.1109/JSEN.2024.3510097\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This systematic review comprehensively scrutinizes transfer learning (TL) methods applied to human activity recognition (HAR) using inertial measurement unit (IMU) data. Our objective is to provide a comprehensive resource for researchers and developers by summarizing the existing activities, feature extractions, and TL techniques in the related studies. Moreover, we identify research gaps in these categories, allowing research endeavors to address these gaps in the future. Our methodology follows the structure of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement by formulating precise research questions, establishing search queries, and specifying inclusion and exclusion criteria for study selection. Finally, we extracted and summarized the existing activities, feature extractions, and TL techniques utilized in the included studies. We analyzed 447 studies from PubMed, ACM, and Scopus datasets, of which we ultimately selected 33 pivotal studies that met our inclusion criteria. Overall, we found that TL has enhanced HAR performance by reusing pretrained models. However, it is important to carefully select relevant transfer information to avoid any potential adverse effects. We conclude that there is a lack of studies assessing specific activities, such as personal hygiene and elder care, using IMU sensors and TL. To improve signal representation, a combination of features based on activity nature is important. Aligning algorithms with activity nature is essential—simpler models like AlexNet are suitable for routine activities such as walking, while more complex models like DenseNet are better for intricate tasks like cleaning. Our review is a reference for advancing the understanding of TL’s potential of HAR using IMU data.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 3\",\"pages\":\"4115-4126\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10786302/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10786302/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Transfer Learning of Human Activities Based on IMU Sensors: A Review
This systematic review comprehensively scrutinizes transfer learning (TL) methods applied to human activity recognition (HAR) using inertial measurement unit (IMU) data. Our objective is to provide a comprehensive resource for researchers and developers by summarizing the existing activities, feature extractions, and TL techniques in the related studies. Moreover, we identify research gaps in these categories, allowing research endeavors to address these gaps in the future. Our methodology follows the structure of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement by formulating precise research questions, establishing search queries, and specifying inclusion and exclusion criteria for study selection. Finally, we extracted and summarized the existing activities, feature extractions, and TL techniques utilized in the included studies. We analyzed 447 studies from PubMed, ACM, and Scopus datasets, of which we ultimately selected 33 pivotal studies that met our inclusion criteria. Overall, we found that TL has enhanced HAR performance by reusing pretrained models. However, it is important to carefully select relevant transfer information to avoid any potential adverse effects. We conclude that there is a lack of studies assessing specific activities, such as personal hygiene and elder care, using IMU sensors and TL. To improve signal representation, a combination of features based on activity nature is important. Aligning algorithms with activity nature is essential—simpler models like AlexNet are suitable for routine activities such as walking, while more complex models like DenseNet are better for intricate tasks like cleaning. Our review is a reference for advancing the understanding of TL’s potential of HAR using IMU data.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice