{"title":"基于层次结构约束的全局和局部统一特征选择算法","authors":"Yibin Wang , Xinru Zhang , Yusheng Cheng","doi":"10.1016/j.eswa.2025.127535","DOIUrl":null,"url":null,"abstract":"<div><div>Existing feature selection methods face challenges when applied to hierarchically structured data, which can be primarily due to a lack of synergy between nodes, resulting in impaired global consistency and poor local coherence. For example, parent nodes may dominate feature weighting without child feedback (e.g., suppressing texture details in fine-grained image classification), while sibling nodes fail to capture asymmetric dependencies in shared features (e.g., genetic markers varying across disease subtypes). To address these issues, a Global and Local Unified Feature Selection algorithm was proposed based on Hierarchical Structure Constraints (GLUFS-HSC). This algorithm integrated global and local perspectives and introduced a bidirectional consistency constraint mechanism for parent–child nodes, along with an asymmetry constraint mechanism for sibling nodes. These innovations enhanced feature selection efficiency and inter-level coordination. The algorithm employed a multi-objective optimization framework to maintain consistency while preserving the original data features. At the global level, it incorporated node relationships and hierarchical requirements by iteratively updating a weight matrix. At the local level, the traditional one-way dependency or implicit bidirectional models were replaced with an explicit parent–child bidirectional consistency constraint, enabling the parent nodes to dynamically adjust the weight distribution based on feedback from child nodes. This approach facilitated information transfer and strengthened hierarchical synergy. For sibling nodes, an asymmetric constraint mechanism combining HSIC constraint and orthogonal constraint is introduced to effectively capture feature differences, reduce feature redundancy, and enhance feature independence and correlation. Experimental comparisons across eight datasets demonstrated that GLUFS-HSC achieved superior performance on hierarchically structured data, significantly improving the consistency and accuracy of feature selection.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"282 ","pages":"Article 127535"},"PeriodicalIF":7.5000,"publicationDate":"2025-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A global and local unified feature selection algorithm based on hierarchical structure constraints\",\"authors\":\"Yibin Wang , Xinru Zhang , Yusheng Cheng\",\"doi\":\"10.1016/j.eswa.2025.127535\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Existing feature selection methods face challenges when applied to hierarchically structured data, which can be primarily due to a lack of synergy between nodes, resulting in impaired global consistency and poor local coherence. For example, parent nodes may dominate feature weighting without child feedback (e.g., suppressing texture details in fine-grained image classification), while sibling nodes fail to capture asymmetric dependencies in shared features (e.g., genetic markers varying across disease subtypes). To address these issues, a Global and Local Unified Feature Selection algorithm was proposed based on Hierarchical Structure Constraints (GLUFS-HSC). This algorithm integrated global and local perspectives and introduced a bidirectional consistency constraint mechanism for parent–child nodes, along with an asymmetry constraint mechanism for sibling nodes. These innovations enhanced feature selection efficiency and inter-level coordination. The algorithm employed a multi-objective optimization framework to maintain consistency while preserving the original data features. At the global level, it incorporated node relationships and hierarchical requirements by iteratively updating a weight matrix. At the local level, the traditional one-way dependency or implicit bidirectional models were replaced with an explicit parent–child bidirectional consistency constraint, enabling the parent nodes to dynamically adjust the weight distribution based on feedback from child nodes. This approach facilitated information transfer and strengthened hierarchical synergy. For sibling nodes, an asymmetric constraint mechanism combining HSIC constraint and orthogonal constraint is introduced to effectively capture feature differences, reduce feature redundancy, and enhance feature independence and correlation. Experimental comparisons across eight datasets demonstrated that GLUFS-HSC achieved superior performance on hierarchically structured data, significantly improving the consistency and accuracy of feature selection.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"282 \",\"pages\":\"Article 127535\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-04-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417425011571\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425011571","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A global and local unified feature selection algorithm based on hierarchical structure constraints
Existing feature selection methods face challenges when applied to hierarchically structured data, which can be primarily due to a lack of synergy between nodes, resulting in impaired global consistency and poor local coherence. For example, parent nodes may dominate feature weighting without child feedback (e.g., suppressing texture details in fine-grained image classification), while sibling nodes fail to capture asymmetric dependencies in shared features (e.g., genetic markers varying across disease subtypes). To address these issues, a Global and Local Unified Feature Selection algorithm was proposed based on Hierarchical Structure Constraints (GLUFS-HSC). This algorithm integrated global and local perspectives and introduced a bidirectional consistency constraint mechanism for parent–child nodes, along with an asymmetry constraint mechanism for sibling nodes. These innovations enhanced feature selection efficiency and inter-level coordination. The algorithm employed a multi-objective optimization framework to maintain consistency while preserving the original data features. At the global level, it incorporated node relationships and hierarchical requirements by iteratively updating a weight matrix. At the local level, the traditional one-way dependency or implicit bidirectional models were replaced with an explicit parent–child bidirectional consistency constraint, enabling the parent nodes to dynamically adjust the weight distribution based on feedback from child nodes. This approach facilitated information transfer and strengthened hierarchical synergy. For sibling nodes, an asymmetric constraint mechanism combining HSIC constraint and orthogonal constraint is introduced to effectively capture feature differences, reduce feature redundancy, and enhance feature independence and correlation. Experimental comparisons across eight datasets demonstrated that GLUFS-HSC achieved superior performance on hierarchically structured data, significantly improving the consistency and accuracy of feature selection.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.