{"title":"基于强化学习的站立辅助座椅","authors":"Renyu Tian, Weizhen Sun","doi":"10.1145/3598151.3598165","DOIUrl":null,"url":null,"abstract":"Sit-to-Stand (STS) is a key factor affecting the independent living of the elderly. Many older adults who can walk independently have to rely on the help of others because of the lack of independent STS ability. The Robot Assisted Standing Seat (RASS) can assist patients with tasks such as autonomous standing and post-operative rehabilitation. Under human biomechanics, RASS finds a compromise between task endpoint accuracy, body balance, energy consumption, and smoothness of motion and control. However, this method based on mathematical modeling requires more work to design a satisfactory control system. In addition, the specificity of the physical function of the elderly leads to great differences in their satisfaction with the RASS work process. This has aroused people's research on customized RASS to meet the needs of different users. To introduce user satisfaction into RASS, this paper proposes a deep reinforcement learning-based RASS. The proposed method takes the user's satisfaction as the reward function of the RL agent and trains a more reasonable control strategy according to the user's habits through online training. In this paper, we preliminarily verified the effectiveness of this idea in a simulation environment.","PeriodicalId":398644,"journal":{"name":"Proceedings of the 2023 3rd International Conference on Robotics and Control Engineering","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Assistive standing seat based on reinforcement learning\",\"authors\":\"Renyu Tian, Weizhen Sun\",\"doi\":\"10.1145/3598151.3598165\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Sit-to-Stand (STS) is a key factor affecting the independent living of the elderly. Many older adults who can walk independently have to rely on the help of others because of the lack of independent STS ability. The Robot Assisted Standing Seat (RASS) can assist patients with tasks such as autonomous standing and post-operative rehabilitation. Under human biomechanics, RASS finds a compromise between task endpoint accuracy, body balance, energy consumption, and smoothness of motion and control. However, this method based on mathematical modeling requires more work to design a satisfactory control system. In addition, the specificity of the physical function of the elderly leads to great differences in their satisfaction with the RASS work process. This has aroused people's research on customized RASS to meet the needs of different users. To introduce user satisfaction into RASS, this paper proposes a deep reinforcement learning-based RASS. The proposed method takes the user's satisfaction as the reward function of the RL agent and trains a more reasonable control strategy according to the user's habits through online training. In this paper, we preliminarily verified the effectiveness of this idea in a simulation environment.\",\"PeriodicalId\":398644,\"journal\":{\"name\":\"Proceedings of the 2023 3rd International Conference on Robotics and Control Engineering\",\"volume\":\"32 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2023 3rd International Conference on Robotics and Control Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3598151.3598165\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2023 3rd International Conference on Robotics and Control Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3598151.3598165","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Assistive standing seat based on reinforcement learning
Sit-to-Stand (STS) is a key factor affecting the independent living of the elderly. Many older adults who can walk independently have to rely on the help of others because of the lack of independent STS ability. The Robot Assisted Standing Seat (RASS) can assist patients with tasks such as autonomous standing and post-operative rehabilitation. Under human biomechanics, RASS finds a compromise between task endpoint accuracy, body balance, energy consumption, and smoothness of motion and control. However, this method based on mathematical modeling requires more work to design a satisfactory control system. In addition, the specificity of the physical function of the elderly leads to great differences in their satisfaction with the RASS work process. This has aroused people's research on customized RASS to meet the needs of different users. To introduce user satisfaction into RASS, this paper proposes a deep reinforcement learning-based RASS. The proposed method takes the user's satisfaction as the reward function of the RL agent and trains a more reasonable control strategy according to the user's habits through online training. In this paper, we preliminarily verified the effectiveness of this idea in a simulation environment.