Chengyuan Ke , Sheng Liu , Yuan Feng , Shengyong Chen
{"title":"用于基于骨骼的动作识别的选择性有向图卷积网络","authors":"Chengyuan Ke , Sheng Liu , Yuan Feng , Shengyong Chen","doi":"10.1016/j.patrec.2025.02.020","DOIUrl":null,"url":null,"abstract":"<div><div>Skeleton-based action recognition has gained significant attention due to the lightweight and robust nature of skeleton representations. However, the feature extraction process often misses subtle action cues, making it challenging to differentiate between similar actions and leading to misclassification. To address this issue, we propose a Selective Directed Graph Convolutional Network (SD-GCN) that decouples features at varying granularities to enhance sensitivity to subtle actions. Specifically, we introduce a Dynamic Topology Generation (DTG) module, which dynamically constructs a new topological structure by focusing on key local joints. This reduces the influence of dominant global features on subtle ones, thereby amplifying fine-grained motion features and improving the distinction between similar actions. Additionally, we present an Attention-guided Group Fusion (AGF) module that selectively evaluates and fuses local motion features of the skeleton while incorporating global skeletal features to capture contextual relationships among all joints. We validated the effectiveness of our method on three benchmark datasets, and experimental results demonstrate that our model not only outperforms existing methods in terms of accuracy but also excels at distinguishing similar actions.</div></div>","PeriodicalId":54638,"journal":{"name":"Pattern Recognition Letters","volume":"190 ","pages":"Pages 141-146"},"PeriodicalIF":3.9000,"publicationDate":"2025-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Selective directed graph convolutional network for skeleton-based action recognition\",\"authors\":\"Chengyuan Ke , Sheng Liu , Yuan Feng , Shengyong Chen\",\"doi\":\"10.1016/j.patrec.2025.02.020\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Skeleton-based action recognition has gained significant attention due to the lightweight and robust nature of skeleton representations. However, the feature extraction process often misses subtle action cues, making it challenging to differentiate between similar actions and leading to misclassification. To address this issue, we propose a Selective Directed Graph Convolutional Network (SD-GCN) that decouples features at varying granularities to enhance sensitivity to subtle actions. Specifically, we introduce a Dynamic Topology Generation (DTG) module, which dynamically constructs a new topological structure by focusing on key local joints. This reduces the influence of dominant global features on subtle ones, thereby amplifying fine-grained motion features and improving the distinction between similar actions. Additionally, we present an Attention-guided Group Fusion (AGF) module that selectively evaluates and fuses local motion features of the skeleton while incorporating global skeletal features to capture contextual relationships among all joints. We validated the effectiveness of our method on three benchmark datasets, and experimental results demonstrate that our model not only outperforms existing methods in terms of accuracy but also excels at distinguishing similar actions.</div></div>\",\"PeriodicalId\":54638,\"journal\":{\"name\":\"Pattern Recognition Letters\",\"volume\":\"190 \",\"pages\":\"Pages 141-146\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-02-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Recognition Letters\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167865525000625\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition Letters","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167865525000625","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Selective directed graph convolutional network for skeleton-based action recognition
Skeleton-based action recognition has gained significant attention due to the lightweight and robust nature of skeleton representations. However, the feature extraction process often misses subtle action cues, making it challenging to differentiate between similar actions and leading to misclassification. To address this issue, we propose a Selective Directed Graph Convolutional Network (SD-GCN) that decouples features at varying granularities to enhance sensitivity to subtle actions. Specifically, we introduce a Dynamic Topology Generation (DTG) module, which dynamically constructs a new topological structure by focusing on key local joints. This reduces the influence of dominant global features on subtle ones, thereby amplifying fine-grained motion features and improving the distinction between similar actions. Additionally, we present an Attention-guided Group Fusion (AGF) module that selectively evaluates and fuses local motion features of the skeleton while incorporating global skeletal features to capture contextual relationships among all joints. We validated the effectiveness of our method on three benchmark datasets, and experimental results demonstrate that our model not only outperforms existing methods in terms of accuracy but also excels at distinguishing similar actions.
期刊介绍:
Pattern Recognition Letters aims at rapid publication of concise articles of a broad interest in pattern recognition.
Subject areas include all the current fields of interest represented by the Technical Committees of the International Association of Pattern Recognition, and other developing themes involving learning and recognition.