{"title":"Defense and Industry Sovereign Capability: IDEaS 2023 [Conference Reports]","authors":"Saeid Nahavandi","doi":"10.1109/msmc.2023.3344368","DOIUrl":"https://doi.org/10.1109/msmc.2023.3344368","url":null,"abstract":"","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"40 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140796499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multiplayer Online Battle Arena Games: Attractive Matchmaking via Group Role Assignment","authors":"Zeyu Li, Haibin Zhu, Dongning Liu","doi":"10.1109/MSMC.2024.3353175","DOIUrl":"https://doi.org/10.1109/MSMC.2024.3353175","url":null,"abstract":"The prisoner’s dilemma (PD) is one of the most popular concepts in scientific literature. This concept is widely used to study various social interactions where participants choose to give up or cooperate in an uninformed environment. This article finds that the matchmaking problem, such as in multiplayer online battle arena (MOBA) games, is a PD problem under mixed preferences (PDUMP). To achieve efficient and feasible matching in MOBA, this article formalizes the problem via group role assignment (GRA). By extending GRA, a new PDUMP solution is proposed. By considering players’ positive and negative preferences, game managers can quickly match players to games. This ensures game fairness and strives to meet participant needs as much as possible. Large-scale experiments verify the effectiveness and practicability of the method and prove that the proposed method can improve the degree of player matching satisfaction.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"283 ","pages":"40-51"},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140782978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Community Detection Method to Counter the Semantic Noise of Complex Networks: Bridging a Topology and Semantic Subspace Transformation","authors":"Ying Li, Yong-Hong Tang, Junwei Cheng, Chaobo He, Feiyi Tang","doi":"10.1109/MSMC.2023.3236163","DOIUrl":"https://doi.org/10.1109/MSMC.2023.3236163","url":null,"abstract":"Community detection of complex networks helps understand the network’s composition and explores the behavior characteristics among users. The methods based on nonnegative matrix factorization (NMF) for community detection have been widely studied and applied because of their flexibility and high interpretability. Nevertheless, accompanied by ideal assumptions, classic community detection methods face the following problems. First, they lead to a mismatch between communities, i.e., topology and semantic information. Second, they cannot overcome the effect of macroscopic semantic noise on methods. Finally, they cannot retain the nodes’ distance information in the high-dimensional topology space. Aiming at the these problems, this article proposes a community detection method with self-perception ability that solves the problem of macro semantic noise. The aforementioned issues are overcome by introducing the subspace transfer module and the generalized Laplacian self-perception module. We understand the network factors that affect the model’s performance through empirical observation. Extensive experiments on six representative methods on several benchmark datasets support our conclusion and demonstrate that our method outperforms the representative methods in many datasets.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"291 1","pages":"2-14"},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140780394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Value-Based Reinforcement Learning for Selective Disassembly Sequence Optimization Problems: Demonstrating and Comparing a Proposed Model","authors":"Shujin Qin, Zhiliang Bi, Jiacun Wang, Shixin Liu, Xiwang Guo, Ziyan Zhao, Liang Qi","doi":"10.1109/MSMC.2023.3303615","DOIUrl":"https://doi.org/10.1109/MSMC.2023.3303615","url":null,"abstract":"Selective optimal disassembly sequencing (SODS) is a methodology for the disassembly of waste products. Mathematically, it is an optimization problem. However, in the existing research, the connection between the optimization algorithms and the established model is limited to some specific processes, and their generality is poor. Due to the unique characteristics of each disassembly product, most disassembly sequences require modification and even reconstruction of the mathematical model. In this article, reinforcement learning (RL) is used to produce a single-item selective disassembly sequence based on the AND/OR graph. First, the AND/OR graph is mapped to a value matrix and represents the precedence relationship between the component and the values of the component itself. Second, on the basis of the established mathematical model and graph, value-based RL is used to solve the selective disassembly sequencing problem. Finally, the experimental results of the genetic algorithm (GA), Sarsa, Deep Q-learning (DQN), and CPLEX are compared to verify the correctness of the proposed model and the effectiveness of the RL algorithm.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"311 22","pages":"24-31"},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140776421","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jorge Yagüe París, Jordán Pascual Espada, Jaime Solís Martínez, R. G. Crespo
{"title":"Search Box System to Improve User Interaction in Knowledge Graph Searches: A Solution for Users Without Expert Skills","authors":"Jorge Yagüe París, Jordán Pascual Espada, Jaime Solís Martínez, R. G. Crespo","doi":"10.1109/MSMC.2023.3304489","DOIUrl":"https://doi.org/10.1109/MSMC.2023.3304489","url":null,"abstract":"Knowledge graphs enable semantic search in a variety of information systems. Some collaborative and public ones have existed for more than a decade. That is the case of Wikidata, one of the most popular knowledge bases today. It contains a graph of entities that has been growing since 2012 to host more than 94 million items. Currently, the exploration of data in Wikidata is a tedious task, especially for inexperienced users: it requires users to go deep into entities and perform a large number of clicks and searches of property names. Our goal is to allow nonexpert users who want to enter new data in Wikidata to be able to examine its ontologies in an agile way so that they can know whether a particular statement is present in the graph. To this end, we propose a new search box for Wikidata, which allows an exploratory search based on chained entities without having to navigate through pages. It is based on the real-time classification of the information that the user enters in the search box and the dynamic generation of suggestions based on the exploration of entities and relationships. A quantitative analysis is performed comparing how many iterations a user needs to perform a set of popular searches with our proposal and standard Wikidata search. The results suggest that interaction can be reduced by about 43%.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"8 5","pages":"53-61"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140524533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning Variable Impedance Control for Robotic Massage With Deep Reinforcement Learning: A Novel Learning Framework","authors":"Zhuoran Li, Chao Zeng, Zhen Deng, Qinling Xu, Bingwei He, Jianwei Zhang","doi":"10.1109/MSMC.2022.3231416","DOIUrl":"https://doi.org/10.1109/MSMC.2022.3231416","url":null,"abstract":"Contact-rich manipulation tasks are difficult to program to be performed by robots. Traditional compliance control methods, such as impedance control, rely excessively on environmental models and are ineffective in the face of increasingly complex contact tasks. Reinforcement learning (RL) has now achieved great success in the fields of games and robotics. Autonomous learning of manipulation skills can empower robots with autonomous decision-making capabilities. To this end, this work introduces a novel learning framework that combines deep RL (DRL) and variable impedance control (VIC) to achieve robotic massage tasks. A skill policy is learned in joint space, which outputs the desired impedance gain and angle for each joint. To address the limitations of the sparse reward of DRL, an intrinsic curiosity module (ICM) was designed, which generates the intrinsic reward to encourage robots to explore more effectively. Simulation and real experiments were performed to verify the effectiveness of the proposed method. Our experiments demonstrate that contact-rich massage skills can be learned through the VIC–DRL framework based on the joint space in a simulation environment, and that the ICM can improve learning efficiency and overall performance in the task. Moreover, the generated policies have been demonstrated to still perform effectively on a real-world robot.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"48 4","pages":"17-27"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140525705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Solving Relay Task Allocation of Unmanned Aerial Vehicles: A Solution Using Group Multirole Assignment","authors":"Anling Lao, Haibin Zhu, Dongning Liu","doi":"10.1109/MSMC.2023.3323778","DOIUrl":"https://doi.org/10.1109/MSMC.2023.3323778","url":null,"abstract":"When multiple unmanned aerial vehicles (UAVs) perform tasks collaboratively, a relay dispatching method has a beneficial effect on the continuity of the task execution; i.e., the UAVs can take off and land using shared base stations. However, an increase of the number of demands and base stations can lead to a rapid increase of the number of involved UAVs. Such conditions may cause frequent conflicts when assigning dispatching base stations according to their stocks and capacity. For this concern, this article formalizes the relay task allocation problem of multiple UAVs (RTAPMU) based on group multirole assignment (GMRA), which is a submodel of E-CARGO, i.e., the general model of role-based collaboration (RBC). Through the revised GMRA model, we linearly constrain the capacity and dynamic inventory of the base station to ensure that there are sufficient UAVs to perform the mission. The proposed method is verified by simulation experiments on real-world problems. Since GMRA is a hard optimization model, the results show that the proposed method can obtain the global optimal solution of a one-day relay task assignment in 6.97 s. Furthermore, large-scale random experiments show that the proposed method is practicable and reasonable.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"11 5","pages":"41-52"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139640851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"State-of-the-Art Elderly Service Robot: Environmental Perception, Compliance Control, Intention Recognition, and Research Challenges","authors":"Xiaofeng Liu, Congyu Huang, Haoran Zhu, Ziyang Wang, Jie Li, Angelo Cangelosi","doi":"10.1109/MSMC.2023.3238855","DOIUrl":"https://doi.org/10.1109/MSMC.2023.3238855","url":null,"abstract":"This article surveys the literature on environmental perception, compliance control, and intention recognition for elderly service robots. Population aging is an inevitable trend in current society, leading to an urgent need for service robots. A high-performance collaborative robot should be able to construct an environment of harmonious and effective human–robot symbiosis. This survey starts with an overview of the environment perception system (e.g., environment 3D reconstruction and object location) for elderly service robots, as environment perception is the basis of human–robot interaction. Furthermore, we report various learning methods deployed in compliance control, which opens the way for the generalization of robots. In this case, we structure our review into three primary domains delimited by learning processes. The article also presents several aspects focusing on processing multimodal signals (e.g., vision, speech, and electromyograms) related to intention recognition. Finally, we briefly discuss several challenges that robots need to overcome to reach interactive performance comparable to humans.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"347 5","pages":"2-16"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139640748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"DALBFog: Deadline-Aware and Load-Balanced Task Scheduling for the Internet of Things in Fog Computing","authors":"Muhammad Ibrahim, Y. Lee, Do-Hyuen Kim","doi":"10.1109/MSMC.2023.3316790","DOIUrl":"https://doi.org/10.1109/MSMC.2023.3316790","url":null,"abstract":"The fog computing paradigm has evolved in the last few years to provide task-scheduling solutions for delay-sensitive Internet of Things (IoT) data. As the resources in fog computing are limited, the challenge is to utilize these computing resources in an efficient way while preserving the deadline requirements of delay-sensitive IoT applications. Various task-scheduling approaches have been introduced in the literature that deal with the various aspects of task scheduling in fog computing, like reducing response time, load imbalance, energy efficiency, minimizing execution time, etc. Considering the deadline requirements and efficient use of the limited resources, this work contributes a delay-aware and load-balanced scheduling mechanism for deadline-constrained IoT applications in fog computing. The proposed scheduling approach aims to schedule the user’s delay-sensitive IoT tasks in such a way that it minimizes the delay, maximizes the acceptance rate of the tasks, minimizes the load imbalance, and improves the utilization of the fog resources with a lower average response time (ART).","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"35 4","pages":"62-71"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140516026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shumi Zhao, Liwen Xie, Yang Song, Yan Tang, Zhijun Li, Peng Shi, Cheng Chen, Jianwei Liu
{"title":"Flexible Skin Electrodes Based on Conductive Hydrogel for Hand Electromyography Sensing and Gesture Recognition: Exploring Conductivity and Mechanical Properties","authors":"Shumi Zhao, Liwen Xie, Yang Song, Yan Tang, Zhijun Li, Peng Shi, Cheng Chen, Jianwei Liu","doi":"10.1109/MSMC.2022.3233708","DOIUrl":"https://doi.org/10.1109/MSMC.2022.3233708","url":null,"abstract":"Robots want to collaborate with humans or mimic human actions, needing various flexible sensors. Flexible skin electrodes are used as human–robot interfaces (HRIs), providing an opportunity for sensing interactions between robot and user. However, traditional electrodes with low skin adhesion prevent their applications in human-assisted robots, especially sweat on the skin surface, resulting in them slipping and even falling off. Thus, sodium casein (SC) is used for improving polyacrylamide (PAAM) hydrogel to fabricate PAAM-SC-conductive hydrogel with excellent conductivity and mechanical properties. The strong interaction of PAAM-SC improves its adhesion, which has an elongation at a break of roughly 3,000%. Additionally, it exhibits extremely low resistance (< 5kΩ), which can be used for electromyography (EMG) sensing. Herein, flexible skin electrodes with four-layer structures are designed. To fabricate flexible skin electrodes for hand gesture recognition, a 3D printer is employed to pattern high-performance Ag wires with structurally soft and stretchable filamentary serpentines to connect an external circuit and the PAAM-SC-conductive hydrogel. Based on the Transformer network model analysis, the classification results in cross validation are more than 85%. Notably, the PAAM-SC hydrogel as a strain sensor attached to a robotic finger can quickly respond to robotic finger movements. We might anticipate that our strategy will improve the harmonized integration between flexible electronics and human skin for smart HRIs, and when a corobot is equipped with the PAAM-SC-conductive hydrogel, the robots can interact and collaborate with humans seamlessly through active perception and matching.","PeriodicalId":516814,"journal":{"name":"IEEE Systems, Man, and Cybernetics Magazine","volume":"18 2","pages":"28-40"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140516887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}