Bastian Pfeifer , Arne Gevaert , Markus Loecher , Andreas Holzinger
{"title":"Tree smoothing: Post-hoc regularization of tree ensembles for interpretable machine learning","authors":"Bastian Pfeifer , Arne Gevaert , Markus Loecher , Andreas Holzinger","doi":"10.1016/j.ins.2024.121564","DOIUrl":"10.1016/j.ins.2024.121564","url":null,"abstract":"<div><div>Random Forests (RFs) are powerful ensemble learning algorithms that are widely used in various machine learning tasks. However, they tend to overfit noisy or irrelevant features, which can result in decreased generalization performance. Post-hoc regularization techniques aim to solve this problem by modifying the structure of the learned ensemble after training. We propose a novel <em>post-hoc regularization via tree smoothing</em> for classification tasks to leverage the reliable class distributions closer to the root node whilst reducing the impact of more specific and potentially noisy splits deeper in the tree. Our novel approach allows for a form of pruning that does not alter the general structure of the trees, adjusting the influence of nodes based on their proximity to the root node. We evaluated the performance of our method on various machine learning benchmark data sets and on cancer data from The Cancer Genome Atlas (TCGA). Our approach demonstrates competitive performance compared to the state-of-the-art and, in the majority of cases, and outperforms it in most cases in terms of prediction accuracy, generalization, and interpretability.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121564"},"PeriodicalIF":8.1,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142445331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Resilient consensus of heterogeneous multi-agent systems under asynchronous optimal DoS attack schedules","authors":"Yan Xie , Lianghao Ji , Xing Guo , Huaqing Li","doi":"10.1016/j.ins.2024.121550","DOIUrl":"10.1016/j.ins.2024.121550","url":null,"abstract":"<div><div>This study aims to address the challenge of achieving resilient consensus in heterogeneous multi-agent systems (MASs) under asynchronous optimal Denial of Service (DoS) attack schedules. Considering the start and duration of adversaries vary from different communication channels of MASs, we mainly focus on how adversaries with limited energy choose channels to launch attacks to cause the greatest damage to system performance. Based on dynamic programming, an asynchronous optimal DoS attack schedules generation algorithm is obtained. Optimal DoS attack schedules provides a basis for designing more effective secure control methods. Then, a distributed resilient control strategy that utilizes an observer-based approach to achieve output consensus in heterogeneous MASs under asynchronous optimal DoS attack schedules is proposed. Additionally, we establish conditions regarding the durations and frequencies of DoS attacks as well. Finally, two simulations are performed to showcase the efficacy of our proposed method.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121550"},"PeriodicalIF":8.1,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142445332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evolutionary stochastic configuration networks for industrial data analytics","authors":"Jianjiao Ji , Dianhui Wang","doi":"10.1016/j.ins.2024.121546","DOIUrl":"10.1016/j.ins.2024.121546","url":null,"abstract":"<div><div>Stochastic configuration network (SCN) with compact architecture is expected for data modeling. However, the hidden-node parameters (HNPs) randomly configured may result in a slow learning process due to the redundant nodes embedded in the model. To resolve this problem, an evolutionary SCN based on an improved differential evolution (DE) algorithm is proposed in this paper. Specifically, the improved DE reuses the assignment information of last hidden node to find an appropriate search scope for the current one; employs a space reduction method to seed a promising population in the scope; and develops a performance-aware scheme to adjust the scale factor of mutation operators. The proposed evolutionary SCNs are compared with other methods on six datasets and then applied for two real-world applications. Experimental results demonstrate that the proposed method obtains superior performance in terms of compactness and accuracy, with great potential for real-world data analysis.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121546"},"PeriodicalIF":8.1,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142442286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tri Truong , Martin Bohner , Ewa Girejko , Agnieszka B. Malinowska , Ngo Van Hoa
{"title":"Granular fuzzy calculus on time scales and its applications to fuzzy dynamic equations","authors":"Tri Truong , Martin Bohner , Ewa Girejko , Agnieszka B. Malinowska , Ngo Van Hoa","doi":"10.1016/j.ins.2024.121547","DOIUrl":"10.1016/j.ins.2024.121547","url":null,"abstract":"<div><div>This paper introduces the foundational theory of fuzzy calculus on time scales, utilizing granular arithmetic operations between fuzzy intervals. These operations are developed based on the concept of the horizontal membership function (HMF), which is applied in multidimensional fuzzy arithmetic (MFA). Furthermore, the paper explores the existence of a unique solution and the continuous dependence of the solution to fuzzy dynamic equations on initial data, employing the Banach fixed-point theorem under a new metric for fuzzy functions in time scales involving the generalized exponential function. Finally, to highlight the practical significance of these results and their potential applications, the paper presents mathematical models relevant to nuclear physics and biology.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121547"},"PeriodicalIF":8.1,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142530654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Control parameter optimisation using the evidence framework for the ant colony optimisation algorithm","authors":"Mlungisi Duma , Bhekisipho Twala , Tshilidzi Marwala","doi":"10.1016/j.ins.2024.121533","DOIUrl":"10.1016/j.ins.2024.121533","url":null,"abstract":"<div><div>The ant colony optimization (ACO) algorithm is a metaheuristic initially designed to solve the travelling salesman problem (TSP). The design of experiments, finding the suitable ACO algorithm configuration, and calibrating the adaptive control parameters are exhaustive and time-consuming exercises, especially for TSPs where the number of cities can exceed 1000. This paper presents an evidence framework driven control parameter optimisation (EFCPO) algorithm for an ACO algorithm solving TSPs. EFCPO performs auto-tuning of the adaptive control parameters and makes recommendations about the ACO algorithms that are best suited for the TSPs in question using the log evidence. In addition, with this ability, the algorithm can take a solution provided by an ACO algorithm and improve the results. The EFCPO accomplishes this over a number of cycles through auto-tuning of the control parameters and re-running the ACO until the process is completed. The capabilities of EFCPO are compared to another configuration tool, irace, using benchmark ACO algorithms to test the efficiency of the framework. The benchmark algorithms make use of a local search strategy to solve TSPs. The results show that ACO algorithms are able to find new and improved solution tours within reasonable times. The improvements are also significant. In addition, ACO algorithms that are best suited for the TSP in question are preferred, making the EFCPO an effective tool for real-time configuration of ACO algorithms for solving TSPs.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121533"},"PeriodicalIF":8.1,"publicationDate":"2024-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142530613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Misshaped boundary classifier model for license plate detection in haze weather using entropy CNN","authors":"Fangfang Ye , Jinming Wang , Congcong Liu","doi":"10.1016/j.ins.2024.121530","DOIUrl":"10.1016/j.ins.2024.121530","url":null,"abstract":"<div><div>Weather that creates haze can cover up car license plates, creating warped lines that make it difficult to see and identify them. This paper suggests a novel Primitive Boundary Classifier Model (PBCM) that uses the unique properties of bright and dark boundaries to solve this problem. Iteratively extracting characteristics from the input image, the PBCM draws volatile borders and ends linearity at particular pixel positions. To detect irregular boundaries in the hidden layers through changes in entropy and regularity terminations, this procedure is combined with linear entropy learning, which is accomplished by altering a convolutional neural network. Identifying the license plate area and its related embedding is possible by finding these terminating border pixel locations. The model evaluates its performance during validation by considering similarity and false rate metrics. The comparative analysis, this model improves the 7.34% detection precision with 15.98% high similarity and 8.95% less false rate for the maximum epochs performance ratio of 90.1% and error rate of 11.2%.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121530"},"PeriodicalIF":8.1,"publicationDate":"2024-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142434401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Label of a linguistic value in a universe of discourse and the truth values of fuzzy propositions","authors":"Zheng Pei , Qiong Liu , Li Yan , Lu Wang","doi":"10.1016/j.ins.2024.121545","DOIUrl":"10.1016/j.ins.2024.121545","url":null,"abstract":"<div><div>Due to objects described by a linguistic value with unsharp or fuzzy boundary, meaning of a linguistic value means different things to different people, the relation between the linguistic value and membership functions as its meaning is one-to-many rather than one-to-one. How to precisiate meaning of a linguistic value and even determine the truth values of fuzzy propositions remain open problems in computing with words (<em>CW</em>). In the paper, label of a linguistic value in its universe of discourse is proposed to formalize a possible position of objects described by the linguistic value, which is determined by a part of objects that can be and can not be described by the linguistic value via a group of users' commonsense knowledge. Then confidence degree of a membership function relative to a linguistic value is presented by measuring “<em>the membership function is close to label of the linguistic value</em>”, which can be used to precisiate meaning of a linguistic value and determine the truth values of fuzzy propositions. Finally, the truth value approximate reasoning of fuzzy propositions in the framework of the generalized modus ponens is provided and employed to evaluate the students' educational achievement. Comparative analysis with educational achievement based on Aliev's <em>Z</em>-interpolation approach and Zadeh's compositional rule of inference show that label of a linguistic value and confidence degree of a membership function relative to the linguistic value are effective and useful tools for <em>CW</em>.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121545"},"PeriodicalIF":8.1,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142422895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haichao Zhang , Haowei Huang , Bing Xiao , Shen Yin , Bo Li
{"title":"Finite-time optimal control for a class of nonlinear systems with performance constraints via critic-only ADP: Theory and experiments","authors":"Haichao Zhang , Haowei Huang , Bing Xiao , Shen Yin , Bo Li","doi":"10.1016/j.ins.2024.121542","DOIUrl":"10.1016/j.ins.2024.121542","url":null,"abstract":"<div><div>This paper addresses the optimal control problem within the framework of adaptive dynamic programming (ADP) for a class of nonlinear systems subjected to performance constraints. A new finite-time optimal control scheme is developed to stabilize the system by using the critic-only neural network ADP method. Compared with the existing ADP-based optimal control methods with uniformly ultimately bounded stability, the provided control scheme ensures that the controlled system's state and neural network weight estimation error are finite-time stable. It can ensure optimality, prescribed performance, and finite-time stability of the closed-loop control system simultaneously through an integration of ADP, the prescribed performance control technique, and Lyapunov theory. The designed adaptive neural network weight update law can relax the persisting excitation condition. The proposed control scheme is implemented on a robotic experiment platform to achieve trajectory tracking and verify its effectiveness.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121542"},"PeriodicalIF":8.1,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142530648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Runduo Han , Xiuping Liu , Yi Zhang , Jun Zhou , Hongchen Tan , Xin Li
{"title":"Hierarchical Event-RGB Interaction Network for single-eye expression recognition","authors":"Runduo Han , Xiuping Liu , Yi Zhang , Jun Zhou , Hongchen Tan , Xin Li","doi":"10.1016/j.ins.2024.121539","DOIUrl":"10.1016/j.ins.2024.121539","url":null,"abstract":"<div><div>The Single-eye Expression Recognition task stands as a crucial vision task, aimed at decoding human emotional states through careful examination of the eye region. Nevertheless, traditional cameras face challenges in detecting and capturing relevant biological information, especially under demanding lighting conditions such as dim environments, high exposure scenarios, or when other radiation sources are present. In this regard, we use a new type of sensor data that can resist extreme lighting conditions, namely event camera data, to improve the performance of single-eye expression recognition. To this end, we propose a novel Hierarchical Event-RGB Interaction Network (HI-Net), to fully integrate RGB and event data to overcome the extreme lighting challenges faced by the single-eye expression recognition task. The HI-Net contains two novel designs: Event-RGB Semantic Interaction Mechanism (ER-SIM) and Hierarchical Semantics Modeling (HSM) Scheme. The former aims to achieve interaction between Event and RGB modality semantics, while the latter aims to obtain high-quality modality semantic representations. In the ER-SIM, we employ an effective cross-attention mechanism to facilitate information fusion, to adaptively integrate and complement multi-scale Event and RGB semantics to cope with extreme lighting conditions. In HSM Scheme, we first explore multi-scale contextual semantics for the event modality and the RGB modality respectively. Then, we perform a semantics interaction strategy for these multi-scale contextual semantics, to enhance each modality's semantic representation. Extensive experiments demonstrate that our HI-Net significantly outperforms many state-of-the-art methods on the single-eye expression recognition task, especially under degraded lighting conditions.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121539"},"PeriodicalIF":8.1,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142445329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards scalable topic detection on web via simulating Lévy walks nature of topics in similarity space","authors":"Junbiao Pang , Qingming Huang","doi":"10.1016/j.ins.2024.121544","DOIUrl":"10.1016/j.ins.2024.121544","url":null,"abstract":"<div><div>Organizing a few webpages from social media into hot topics is one of the key steps to understand trends on web. Discovering popular yet hot topics from web faces a sea of noise webpages which never evolve into popular topics. In this paper, we discover that the similarity values between webpages in a popular topic contain the statistically similar features observed in Lévy walks. Consequently, we present a simple, novel, yet very powerful Explore-Exploit (EE) approach to group topics by simulating Lévy walks nature in the similarity space. The proposed EE-based topic clustering is an effective and efficient method which is a solid move towards handling a sea of noise webpages. Experiments on two public data sets demonstrate that our approach is not only comparable to the State-Of-The-Art (SOTA) methods in terms of effectiveness but also significantly outperforms the SOTA methods in terms of efficiency.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"690 ","pages":"Article 121544"},"PeriodicalIF":8.1,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142434399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}