{"title":"Adaptive decomposition-based evolutionary algorithm for many-objective optimization with two-stage dual-density judgment","authors":"Yongjun Sun, Jiaqi Liu, Zujun Liu","doi":"10.1016/j.asoc.2024.112434","DOIUrl":"10.1016/j.asoc.2024.112434","url":null,"abstract":"<div><div>In order to better balance the convergence and diversity of MOEA/D for many objective optimization problems (MaOPs) with various Pareto fronts (PFs), an adaptive decomposition-based evolutionary algorithm for MaOPs with two-stage dual-density judgment is proposed. To solve the problem that weighted Tchebycheff decomposition may produce weakly Pareto optimal solutions when the solution is not unique or the uniqueness is difficult to guarantee, an augmented weighted Tchebycheff decomposition is adopted. To balance the convergence and diversity of non-dominated solutions in the external archive, different sparsity-level evaluations using vector angles or Euclidean distances are used to measure the distribution of solutions at different stages. To improve the diversity of solution sets obtained by MOEA/D for various PFs, an adaptive weight vector adjustment method based on two-stage dual-density judgment is presented. For weight vector addition, the potential search area is found according to the two-stage density judgment, and then a two-stage sparsity level judgment on the solutions of this area is performed for a second density judgment. For weight vector deletion, the degree of crowding is used to delete the weight vectors with a high crowding degree. Compared with nine advanced multi-objective optimization algorithms on DTLZ and WFG problems, the results demonstrate that the performance of the proposed algorithm is significantly better than other algorithms.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112434"},"PeriodicalIF":7.2,"publicationDate":"2024-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142654123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An effective surrogate-assisted rank method for evolutionary neural architecture search","authors":"Yu Xue, Anjing Zhu","doi":"10.1016/j.asoc.2024.112392","DOIUrl":"10.1016/j.asoc.2024.112392","url":null,"abstract":"<div><div>Evolutionary neural architecture search (ENAS) is able to automatically design high-performed architectures of deep neural networks (DNNs) for specific tasks. In recent years, surrogate models have gained significant traction because they can estimate the performance of neural architectures, avoiding excessive computational costs for training. However, most existing surrogate models primarily predict the performance of architectures directly or predict pairwise comparison relationships, which makes it challenging to obtain the rank of a group of architectures when training samples are limited. To address this problem, we propose TCMR-ENAS, an effective triple-competition model-assisted rank method for ENAS. TCMR-ENAS employs a novel triple-competition surrogate model combined with a score-based fitness evaluation method to predict group performance rank. Moreover, a progressive online learning method is proposed to enhance the predictive performance of the triple-competition surrogate model in the framework of modified genetic search. To validate the effectiveness of TCMR-ENAS, we conducted a series of experiments on NAS-Bench-101, NAS-Bench-201, NATS-Bench and NAS-Bench-301, respectively. Experimental results show that TCMR-ENAS can achieve better performance with lower computational resources. The accuracies of searched architectures achieve the best results compared with those of the state-of-the-art methods with limited training samples. In addition, the factors that may influence the effectiveness of TCMR-ENAS are explored in the ablation studies.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112392"},"PeriodicalIF":7.2,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142586405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Minglan Zhang , Linfu Sun , Jing Yang , Yisheng Zou
{"title":"A shared multi-scale lightweight convolution generative network for few-shot multivariate time series forecasting","authors":"Minglan Zhang , Linfu Sun , Jing Yang , Yisheng Zou","doi":"10.1016/j.asoc.2024.112420","DOIUrl":"10.1016/j.asoc.2024.112420","url":null,"abstract":"<div><div>Time series forecasting is an important time series data mining technique. Among them, multivariate time series (MTS) forecasting has received extensive attention in many fields. However, many existing MTS forecasting models usually rely on a large amount of labeled data for model training, and data collection and labeling are difficult in real systems. The insufficient amount of data makes it difficult for the model to fully learn the intrinsic patterns and features of the data, which not only increases the prediction error, but also makes it hard to obtain satisfactory prediction results. To address this challenge, we propose a shared multi-scale lightweight convolution generative (SMLCG) network for few-shot multivariate time series forecasting by using samples generation strategy. The overall goal is to design a shared multi-scale feature generation prediction framework that generates data highly similar to the original sample and enriches the training sample to improve prediction accuracy. Specifically, the MTS is divided into different scales, and the multi-scale feature fusion module is utilized to capture and fuse the MTS information in different spatial dimensions to eliminate the heterogeneity among the data. Then, the key information in the multi-scale features is captured by a lightweight convolution generative network, and the feature weights are dynamically assigned to explore the change information. In addition, a spatio-temporal memory module is designed based on the parameter sharing strategy to capture the spatio-temporal dynamic relationship of sequences by learning the common knowledge in multi-scale features, thus improving the robustness and generalization ability. Through comprehensive experiments on four publicly available datasets and comparisons with other reported models, it is demonstrated that the SMLCG model can efficiently generate approximate samples in the few-shot case and provide excellent prediction results. The architecture of SMLCG serves as a valuable reference for practical solutions to address the few-shot problem in multivariate time series.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112420"},"PeriodicalIF":7.2,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142656735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An altitude-aware fuzzy approach for energy efficiency in UAV-assisted 3D Wireless Sensor Networks","authors":"Seyyit Alper Sert , Adnan Yazici","doi":"10.1016/j.asoc.2024.112424","DOIUrl":"10.1016/j.asoc.2024.112424","url":null,"abstract":"<div><div>In Wireless Sensor Networks (WSNs) that use multi-hop topologies, issues like energy holes and hotspots have become prominent. To address these, recent research has proposed using mobile sinks with abundant resources. These include mobile robots, drones, and notably, Unmanned Aerial Vehicles (UAVs), as solutions to alleviate these challenges. This paper introduces a novel altitude-aware fuzzy approach aimed at improving energy efficiency in UAV-supported 3D WSNs. The proposed methodology comprises two key components. Firstly, a tailored fuzzy clustering algorithm is developed to manage the spatial structure of the 3D WSN, optimizing energy consumption. Secondly, a hybrid grey wolf optimization algorithm is utilized to fine-tune the parameters of the fuzzy clustering algorithm, ensuring optimal performance. The synergistic and seamless integration of these components addresses the energy efficiency challenges inherent in UAV-assisted 3D WSNs. The significance of this approach lies in its capacity to navigate the escalating complexity and energy demands of modern sensor networks, offering a harmonious blend of theoretical innovation and practical applicability. Experimental analysis and results substantiate the superior performance of the proposed approach compared to existing solutions, as measured by the metrics commonly employed to evaluate the network lifetime of protocols in the literature.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112424"},"PeriodicalIF":7.2,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142656739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Medical image segmentation network based on feature filtering with low number of parameters","authors":"Zitong Ren , Zhiqing Guo , Liejun Wang, Lianghui Xu, Chao Liu","doi":"10.1016/j.asoc.2024.112399","DOIUrl":"10.1016/j.asoc.2024.112399","url":null,"abstract":"<div><div>In recent years, the medical image segmentation method based on hybrid convolutional neural network (CNN) and Vision Transformer (ViT) has made great progress, but it still faces the challenge of unbalanced global and local modeling, and excessive parameters. In addition, ViT repeatedly uses the whole feature map to model the global information, thus generating irrelevant and weakly related information, which will weaken the performance of the model when facing small datasets and segmentation targets. Therefore, this paper proposes a feature screening network based on similarity, named Screening Feature (SF)-MixedNet. Specifically, this paper first proposes a new feature extractor, namely Correlation based Similarity Transformer (CSimFormer). On the basis of parameter pruning, it uses the Screening Feature Multi-head Self Attention (SF-MSA) to establish the remote dependency, and calculates the similarity between local elements through the Location-Sensitive Mechanism (LsM) to obtain the weight matrix. Then, the correlation between regional elements is mined by Region Matching and Selection (RMS) mechanism, and the obtained information is filtered according to the corresponding rules to reduce the side effects of redundant information. Extensive experiments on Synapse dataset, ACDC dataset and SegPC-2021 dataset show that the segmentation accuracy reaches 83.51%, 92.20% and 81.27% respectively. Especially in the Synapse dataset, our method is 6.31% higher than the baseline. The method proposed in this paper effectively improves the segmentation accuracy, provides more detailed information for medical diagnosis and promotes the development of medical artificial intelligence technology.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112399"},"PeriodicalIF":7.2,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142578870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hao Pu , Ting Hu , Taoran Song , Paul Schonfeld , Wei Li , Lihui Peng
{"title":"Knowledge graph-driven mountain railway alignment optimization integrating karst hazard assessment","authors":"Hao Pu , Ting Hu , Taoran Song , Paul Schonfeld , Wei Li , Lihui Peng","doi":"10.1016/j.asoc.2024.112421","DOIUrl":"10.1016/j.asoc.2024.112421","url":null,"abstract":"<div><div>Karst hazard is a considerable threat that should be considered in railway alignment design for mountainous regions with dense water systems. Nevertheless, alignment design principles in karst regions have not been systematically studied. Moreover, a quantitative karst hazard assessment model is currently lacking for automated alignment optimization. To solve the above problems, based on the analyses of karst inducing factors and hazard representation, the railway alignment design principles in karst regions are summarized through an event tree. A highly-coupled knowledge graph (called KaRAD-KG) modeling method is proposed. Then, a bi-objective alignment optimization model considering railway construction cost and karst hazard (mainly including hazard components of synclinal karst, anticlinal karst and karst depression) is constructed. To solve the optimization model, a knowledge-driven distance transform algorithm incorporating a karst hazard assessment method and a multicriteria tournament decision method is customized. Finally, the application in a real-world case indicates that the proposed method can generate an alignment which reduces construction cost by 3.39 % and karst hazard by 18.73 % compared to the best manually-designed alternative, which verifies the effectiveness of this method for assisting actual railway alignment design in a karst-dense mountainous region.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112421"},"PeriodicalIF":7.2,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142578866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Spatial-temporal analysis and trend prediction of regional crop disease based on electronic medical records","authors":"Chang Xu , Lei Zhao , Haojie Wen , Lingxian Zhang","doi":"10.1016/j.asoc.2024.112423","DOIUrl":"10.1016/j.asoc.2024.112423","url":null,"abstract":"<div><div>Intelligent diagnosis of individual crop diseases has matured. How to understand the evolution patterns and predict regional disease trends remains a significant challenge. Plant Electronic Medical Records (PEMRs) offer valuable spatial-temporal characteristics about crop diseases, presenting a new opportunity for predicting the occurrence of regional diseases. In this study, we used a large prescription database from Beijing (2018–2021) to reframe regional disease prediction as a time series forecasting task. Firstly, to analyze spatial-temporal evolution patterns, we use ArcGIS to extract key information and identify potential connections between different disease occurrence points. Then, we developed a novel deep learning combined model SV-CBA, which combines Seasonal and Trend decomposition (STL) with Variational Mode Decomposition (VMD) to identify trend, seasonal, and residual components, and re-decomposes the residuals. STL-VMD can capture long-term trends and periodic variations while managing nonlinear and volatile characteristics. The CNN-BiLSTM-Attention model calculates disease trends by linearly integrating predictions of each sub-series. To reduce computational complexity while maintaining predictive performance, we propose an improved simplified attention mechanism. Our model demonstrates superior performance in both comparative and ablation experiments using the PEMRs dataset, outperforming numerous other models. This study provides accurate disease trend predictions, aiding farmers and regional managers in agricultural production management.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112423"},"PeriodicalIF":7.2,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142656741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jian Liu , Shuaicong Hu , Yanan Wang , Wei Xiang , Qihan Hu , Cuiwei Yang
{"title":"Personalized blood pressure estimation using multiview fusion information of wearable physiological signals and transfer learning","authors":"Jian Liu , Shuaicong Hu , Yanan Wang , Wei Xiang , Qihan Hu , Cuiwei Yang","doi":"10.1016/j.asoc.2024.112390","DOIUrl":"10.1016/j.asoc.2024.112390","url":null,"abstract":"<div><div>Continuous blood pressure (BP) monitoring is crucial for individual health management, yet the significant inter-individual variations among patients pose challenges to achieving precision medicine. In response to this issue, we propose a parallel cross-hybrid architecture that integrates a convolutional neural network backbone and a Mix-Transformer backbone. This model, grounded in multi-view physiological signals and personalized fine-tuning strategies, aims to estimate BP, facilitating the capture of physiological information across diverse receptive fields and enhancing network expressive capabilities. Our proposed architecture exhibits superior performance in estimating systolic blood pressure and diastolic blood pressure, with average absolute errors of 3.94 mmHg and 2.24 mmHg, respectively. These results surpass existing baseline models and align with the standards set by the British Hypertension Society, the Association for the Advancement of Medical Instrumentation, and the Institute of Electrical and Electronics Engineers for BP measurement. Additionally, this study explores a personalized model fine-tuning strategy by adjusting specific layers and incorporating individual information, presenting an optimal solution. The model's generalization ability is validated through transfer learning across databases (public and self-made). To enhance the proposed architecture's usability in wearable devices, this study employs a knowledge distillation strategy for model lightweighting, with preliminary application in our designed real-time BP estimation system. This study provides an efficient and accurate solution for personalized BP estimation, exhibiting broad potential applications.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112390"},"PeriodicalIF":7.2,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142656732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shunnan Wang , Min Gao , Huan Wu , Fengji Luo , Feng jiang , Liang Tao
{"title":"Many-to-many: Domain adaptation for water quality prediction","authors":"Shunnan Wang , Min Gao , Huan Wu , Fengji Luo , Feng jiang , Liang Tao","doi":"10.1016/j.asoc.2024.112381","DOIUrl":"10.1016/j.asoc.2024.112381","url":null,"abstract":"<div><div>Predicting water quality is crucial for sustainable water management. To mitigate data scarcity for specific water quality targets, domain adaptation methods have been employed, adjusting a model to perform in a related domain and leveraging learned knowledge to bridge domain differences. However, these methods often fall short by overfitting certain domain-specific patterns, overlooking consistent water quality patterns in multi-water domains. Despite regional variations, these Consistent patterns show fundamental commonalities and can be observed across monitoring sites, stemming from their widespread and interconnected nature. Addressing these limitations, we introduce the Many-to-Many Domain Adaptation framework (M2M) for prediction to bridge the gap between multi-source domains and multi-target domains, aligning shared insights with the distinct profiles of individual monitoring sites while considering their geographical interconnections. M2M adeptly addresses the formidable challenge of concurrently deciphering and integrating multifaceted patterns across an array of source and target domains, while also navigating the intricate regional heterogeneity intrinsic to the water quality of different sites. The M2M includes a domain pattern fusion module for consistent pattern extraction and numerical scale maintenance from source domains, a domain pattern sharing module for sharing pattern extraction from target domains, and an M2M learning method to ensure the training of these modules. Extensive experiments conducted on 120 diverse monitoring stations demonstrate that M2M markedly enhances the accuracy of water quality predictions using various time series encoders. Code available at <span><span>https://github.com/biya0105/M2M</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112381"},"PeriodicalIF":7.2,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142654071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Privacy preserving verifiable federated learning scheme using blockchain and homomorphic encryption","authors":"Ganesh Kumar Mahato , Aiswaryya Banerjee , Swarnendu Kumar Chakraborty , Xiao-Zhi Gao","doi":"10.1016/j.asoc.2024.112405","DOIUrl":"10.1016/j.asoc.2024.112405","url":null,"abstract":"<div><div>This paper introduces a novel Privacy-Preserving Verifiable Federated Learning (PPVFL) scheme that integrates blockchain technology and homomorphic encryption to address critical challenges in decentralized machine learning. The proposed scheme ensures data privacy, integrity, verifiability, robust security, and efficiency in collaborative learning environments, particularly in sensitive domains such as healthcare. By leveraging blockchain’s decentralized, immutable ledger and homomorphic encryption’s capability to perform computations on encrypted data, the model maintains the confidentiality of sensitive information throughout the learning process. The inclusion of Byzantine fault tolerance and Elliptic Curve Digital Signature Algorithm (ECDSA) further enhances the system’s security against malicious attacks and data tampering, while the optimization of computational processes ensures efficient model training and communication. The novelty of this work lies in the seamless integration of blockchain and homomorphic encryption within a federated learning framework, specifically tailored for post-quantum cryptography, a combination that has not been extensively explored in prior research. This research represents a significant advancement in secure and efficient federated learning, offering a promising solution for industries that prioritize data privacy, security, and trust in collaborative machine learning. The effectiveness, security, and efficiency of the PPVFL scheme were validated using the Glaucoma dataset. The proposed method outperformed baseline federated learning algorithms, achieving a Dice coefficient of 0.918 and a Hausdorff distance of 4.05 on Severe Glaucoma (SG) cases, compared to 0.905 and 5.27, respectively, with traditional FedAvg. Moreover, the integration of blockchain and homomorphic encryption ensured that data privacy was upheld without compromising model performance, while efficient computation and communication processes minimized latency and resource consumption. This study contributes a robust, privacy-preserving, secure, efficient, and verifiable federated learning framework that addresses the pressing need for secure and scalable data management in distributed machine learning environments.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112405"},"PeriodicalIF":7.2,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142578869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}