Xiaoran Kong , Jianyong Yang , Xinghua Chai , Yatong Zhou
{"title":"An advantage duPLEX dueling multi-agent Q-learning algorithm for multi-UAV cooperative target search in unknown environments","authors":"Xiaoran Kong , Jianyong Yang , Xinghua Chai , Yatong Zhou","doi":"10.1016/j.simpat.2025.103118","DOIUrl":"10.1016/j.simpat.2025.103118","url":null,"abstract":"<div><div>Multiple unmanned aerial vehicles (UAVs) cooperative target search has been extensively applied in post-disaster relief and surveillance tasks. However, achieving efficient cooperative target search in unknown environments without prior information is extremely challenging. In the study, a novel multi-agent deep reinforcement learning (MADRL)-based approach is proposed to enable UAVs to execute target search in the three-dimensional (3D) unknown environments. Specifically, the target search problem is formulated as a decentralized partially observable Markov decision processes (Dec-POMDP), where each UAV maintains its own target existence probability map and merges with those of other UAVs within communication range to enhance UAVs’ perception of task environment. Then, an improved duPLEX dueling multi-agent Q-learning (QPLEX) algorithm called Advantage QPLEX is proposed to make the optimal decision for multiple UAVs target search. The Advantage QPLEX can guide UAVs to focus on the advantage steps during the search to improve search efficiency, and direct UAVs to select the advantage action in each step for a greater return. In addition, a novel reward function is well-designed for cooperative target search problems to drive UAVs to explore and utilize the environmental information efficiently. Extensive simulations conducted on the Airsim validate that the Advantage QPLEX outperforms the existing algorithms in terms of the coverage rate and search rate.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103118"},"PeriodicalIF":3.5,"publicationDate":"2025-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143834188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An iterative surrogate-based optimization approach for multi-server queuing system design","authors":"Carla Pineda, Alfredo Santana, Rafael Batres","doi":"10.1016/j.simpat.2025.103119","DOIUrl":"10.1016/j.simpat.2025.103119","url":null,"abstract":"<div><div>Queuing systems play an important role in numerous domains, including banks, supermarkets, traffic control, call centers, and production processes. Traditional methods for designing multi-server queuing systems often rely on trial-and-error or extensive simulations, making them time-consuming and computationally expensive. This paper addresses these challenges using MEVO (Metamodel-based Evolutionary Optimizer), a surrogate-based optimization algorithm. MEVO employs a machine-learning model as a surrogate model, reducing reliance on computationally intensive simulations. The algorithm also integrates evolutionary operators for efficient solution space exploration, a long-term memory strategy to avoid redundant simulations, and a dynamic search space reduction mechanism to enhance optimization efficiency.</div><div>A case study of a supermarket checkout system, modeled in FlexSim, demonstrates the algorithm’s efficacy in optimizing queuing configurations under stochastic variables such as customer arrival rates, basket sizes, and transaction values. MEVO achieves solution-quality performance comparable to the FlexSim optimizer while significantly reducing computation times. MEVO also delivers comparable computational performance to Bayesian optimization while exhibiting lower variance in objective-function results than FlexSim, highlighting its consistency and robustness.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103119"},"PeriodicalIF":3.5,"publicationDate":"2025-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143799921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jing Guo, Jin Qi, Jie Hu, Chengan Hong, Yuliang Shen, Haiqing Huang, Weijie Liu
{"title":"Robust optimization method for co-simulation of equipment based on EDEM-ADAMS","authors":"Jing Guo, Jin Qi, Jie Hu, Chengan Hong, Yuliang Shen, Haiqing Huang, Weijie Liu","doi":"10.1016/j.simpat.2025.103124","DOIUrl":"10.1016/j.simpat.2025.103124","url":null,"abstract":"<div><div>Tunneling machines, pivotal in rock tunnel excavation, utilize cutting mechanisms for rock fragmentation. As the core component of the cutting mechanism, the cutting head experiences severe vibrations during the rock breaking process when subjected to large loads, which adversely affects the working performance of the tunneling machines. The precision and efficiency of cutting force simulation for the cutting head are crucial for equipment design optimization and performance assessment. Therefore, exploring robust simulation time steps is particularly significant. This paper leverages state-of-the-art simulation techniques to boost the accuracy and computational performance of cutting head simulation. Firstly, by setting 44 different combinations of EDEM-ADAMS time steps, simulations are conducted in four different environments to collect cutting forces and simulation time data. Then, in view of this dataset, the radial basis function (RBF) approximation model is developed to simultaneously predict cutting forces and simulation time under four environments, which enhances the accuracy and applicability of the predictions. Finally, targeting the minimization of relative error, fluctuation magnitude, and simulation time, the NSGA-II algorithm is further utilized for multi-objective iterative optimization to obtain the time step combination with excellent performance. The results demonstrate that the optimized method reduces the relative error by 67.8 %, the fluctuation magnitude by 43.6 %, and the simulation time by 31.8 %. These improvements highlight the effectiveness of the optimization approach in enhancing both the precision of cutting force prediction and the stability of the simulation process, while maintaining computational efficiency.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103124"},"PeriodicalIF":3.5,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143821532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wolfgang Seiringer , Klaus Altendorfer , Thomas Felberbauer , Balwin Bokor , Fabian Brockmann
{"title":"How periodic forecast updates influence MRP planning parameters: A simulation study","authors":"Wolfgang Seiringer , Klaus Altendorfer , Thomas Felberbauer , Balwin Bokor , Fabian Brockmann","doi":"10.1016/j.simpat.2025.103115","DOIUrl":"10.1016/j.simpat.2025.103115","url":null,"abstract":"<div><div>In many supply chains, the current efforts at digitalization have led to improved information exchanges between manufacturers and their customers. Specifically, demand forecasts are often provided by the customers and regularly updated as the related customer information improves. In this paper, we investigate the influence of forecast updates on the production planning method of Material Requirements Planning (MRP). A simulation study was carried out to assess how updates in information affect the setting of planning parameters in a rolling horizon MRP planned production system. An intuitive result is that information updates lead to disturbances in the production orders for the MRP standard, and, therefore, an extension for MRP to mitigate these effects is developed. A large numerical simulation experiment shows that the MRP safety stock exploitation heuristic, that has been developed, leads to significantly improved results as far as inventory and backorder costs are concerned. An interesting result is that the fixed-order-quantity lotsizing policy performs—in most instances—better than the fixed-order-period lotsizing policy, when periodic forecast updates occur. In addition, the simulation study shows that underestimating demand is marginally more costly than overestimating it, based on the comparative analysis of all instances. Furthermore, the results indicate that the MRP safety stock exploitation heuristic can mitigate the negative effects of biased forecasts.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103115"},"PeriodicalIF":3.5,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143761236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michaelraj Kingston ROBERTS , Jeevanandham S , Jaime Lloret , Fadl Dahan
{"title":"An innovative dual-phased synergistic energy management approach for WSNs using enhanced sleep/awake scheduling and adaptive routing process","authors":"Michaelraj Kingston ROBERTS , Jeevanandham S , Jaime Lloret , Fadl Dahan","doi":"10.1016/j.simpat.2025.103120","DOIUrl":"10.1016/j.simpat.2025.103120","url":null,"abstract":"<div><div>Wireless Sensor Networks (WSNs) have established themselves as one of the essential technologies in various applications, yet they face significant challenges due to their limited energy resources. To overcome this shortcoming, this work introduces an innovative dual-phased synergistic energy management approach that integrates enhanced sleep/awake scheduling based on Multi-Objective Particle Swarm Optimization with Crowding Distance (MOPSO<img>CD) and Reservoir Computing (RC) based adaptive routing for optimizing energy consumption using dynamic real time-based node state adjustment mechanism. Experimental outcomes obtained through comprehensive simulations indicate that our proposed methodology achieves up to 32 % reduction in energy consumption per node, a 50 % improvement in extending network lifetime, and a 11 % enhancement in Packet Delivery Ratio (PDR) compared to state-of-the art algorithms. Additionally, the proposed method minimizes the computational overhead by 40 % which ensures reliability in dynamic environmental conditions. This outstanding performance is attributed to the intelligent integration of RC-driven energy predictions with adaptive routing and optimized clustering, which offers significant advancement in energy management strategies for WSNs, paving the path for sustainable and reliable network deployment.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103120"},"PeriodicalIF":3.5,"publicationDate":"2025-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143761234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jingyu Tan , Wenke Zhang , Tingting Nong , Zhichao Zhang , Tao Wang , Yi Ma , Eric Wai Ming Lee , Meng Shi
{"title":"An improved social force model based on nucleus force theory to simulate building evacuation in different visibility conditions","authors":"Jingyu Tan , Wenke Zhang , Tingting Nong , Zhichao Zhang , Tao Wang , Yi Ma , Eric Wai Ming Lee , Meng Shi","doi":"10.1016/j.simpat.2025.103117","DOIUrl":"10.1016/j.simpat.2025.103117","url":null,"abstract":"<div><div>Accurately simulating pedestrian behaviour under different visibility conditions is crucial for reducing casualties during emergency fire evacuations. Current research employing social force models typically simulates pedestrian behaviour based on interaction forces under specific visibility conditions. However, these studies often inadequately capture the dynamic effects of visibility changes on pedestrian interaction forces. Based on the nucleus force theory, this study developed an improved social force model (NSFM), incorporating environmental visibility parameters, establishing corresponding pedestrian movement rules. Additionally, we investigated the interaction between pedestrians and walls to determine the optimal parameters. The model’s accuracy was then validated by comparing its simulations under specific visibility conditions from previous visibility-based evacuation experiments and results from other models. Furthermore, we conducted simulations under different visibility conditions, the results show that reduced visibility intensifies wall-following behaviour and herd effects, leading to more detour behaviour, slower movement velocity, and longer evacuation times. As visibility increases, the impact on evacuation gradually diminishes. Finally, we investigated the impact of the number and location of exits and discovered that increasing the number substantially reduces evacuation time, while changes in exit locations can notably affect evacuation efficiency. The numerical simulation results demonstrate that the NSFM has significant potential for simulating pedestrian evacuation behaviour and processes under different visibility conditions, providing a scientific basis for designing more effective evacuation strategies in the future.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103117"},"PeriodicalIF":3.5,"publicationDate":"2025-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143746989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development and assessment of a spreadsheet-based decision support framework for optimal reconstitution of cohesionless soils","authors":"Punit Bhanwar, Trudeep N. Dave","doi":"10.1016/j.simpat.2025.103116","DOIUrl":"10.1016/j.simpat.2025.103116","url":null,"abstract":"<div><div>Analyzing various geotechnical problems associated with cohesionless soils necessitates the creation of a physical model exhibiting a uniformly reconstituted soil structure. However, reconstituting such a well-conditioned model with complex reconstitution criteria or goals using the conventional air pluviation technique is an intricate task. To address this challenge, the present study proposes a novel Spreadsheet-based Pluviation Parametric Optimizer (SPPO), which is purposely developed for the systematized, controlled, and optimal reconstitution of cohesionless soils. A cohesive integration of a Mechatronic-Assisted Air Pluviation System (MAPS) and the Taguchi-VIKOR-based Multi-response Optimization (TV-MRO) algorithm, devised through SPPO, is utilized to achieve the aforementioned optimal reconstitution. To verify the competence of the decision support framework offered by SPPO, the reconstitution of a poorly graded quartz sand (D<sub>50</sub>=0.22 mm) considering five modelled reconstitution scenarios was conducted. For each modelled reconstitution scenario, SPPO identified an optimal pluviation setting, which was further validated by a confirmatory experiment and a devised optimality criterion. Additionally, it was revealed that the height of fall is the most influential parameter in optimal reconstitution, followed by diffuser ratio and sieve porosity. Overall, it is anticipated that the adoption of SPPO can be effective in reconstituting cohesionless soils with much less reconstitution effort, time, and resource deployment compared to conventional reconstitution methodologies.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103116"},"PeriodicalIF":3.5,"publicationDate":"2025-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143738911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eman Ouda, Andrei Sleptchenko, Mecit Can Emre Simsekler
{"title":"How resilient is your emergency department to inflow surges? A novel multidimensional framework for resilience enhancement","authors":"Eman Ouda, Andrei Sleptchenko, Mecit Can Emre Simsekler","doi":"10.1016/j.simpat.2025.103105","DOIUrl":"10.1016/j.simpat.2025.103105","url":null,"abstract":"<div><div>Emergency Departments (EDs) encounter numerous operational challenges, uncertainties, and sudden surges in patient arrivals, often resulting in overcrowding. This overcrowding can impact patient outcomes, staff satisfaction, and the overall functionality of the system. Therefore, it is crucial to strengthen the resilience of these departments in the face of such uncertainties. In this study, we aim to identify the key factors contributing to ED overcrowding and develop a comprehensive hierarchical multidimensional resilience model. This model categorizes the components of three crowding assessment tools: NEDOCS, EDWIN, and READI, into two main categories, recoverability and resistance. The proposed approach demonstrates promising results as we apply it to examine three case studies using Discrete Event Simulation (DES). The subsequent phase involves providing strategic recommendations to improve the ED’s performance and serves as a valuable tool for proactive system failure prevention. These recommendations encompass augmenting available resources and optimizing patient pathways, all aimed at enhancing the ED’s ability to operate effectively. Our findings underscore the accuracy of the DES model in predicting the ED system’s performance under various conditions, ranging from normal patient influx scenarios to high patient influx scenarios. This generalizable hierarchical resilience model aids decision-makers in comprehending system factors for better resource allocation and management decisions.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103105"},"PeriodicalIF":3.5,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143725085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gabriel Fedorko , Martin Kostovčík , Nikoleta Mikušová , Hana Neradilová , Vieroslav Molnár , Martin Ďuriška
{"title":"Using blockchain technology in the computer simulation of logistics processes","authors":"Gabriel Fedorko , Martin Kostovčík , Nikoleta Mikušová , Hana Neradilová , Vieroslav Molnár , Martin Ďuriška","doi":"10.1016/j.simpat.2025.103104","DOIUrl":"10.1016/j.simpat.2025.103104","url":null,"abstract":"<div><div>Blockchain became known to the public in connection with the development of cryptocurrencies. However, blockchain and blockchain technology have much greater possibilities for use within various areas. One of these areas is computer simulation in supply chain and logistics. Integrating the simulation model into the blockchain can present the connection between logistics and blockchain applications. The base of the study was a simulation model of a production line modelled on the logistics principle. The primary goal of this study is to use the blockchain to record, store and verify the authenticity of the simulation model of the logistics process associated with supply in the production process. It is a solution with significant application possibilities through active work with the simulation model and its frequent supply chain and logistics modifications. At the same time, this functionality could be directly integrated into simulation tools in the future. The study confirmed that the simulation model and the results of simulation experiments can be securely written and stored in the blockchain, ensuring their validity, verifiability and trustworthiness. The obtained results in the form of verification of the recording of the simulation model in the blockchain, the use of the blockchain for the validation of the simulation model and the possibility of its download create a prerequisite for its application extension to the field of computer simulation for logistics and application fields of logistics.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103104"},"PeriodicalIF":3.5,"publicationDate":"2025-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143697410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maciej Milewski , Jakub Wróbel , Artur Kierzkowski , David Vališ
{"title":"Experimental and numerical modal analysis of an unmanned aerial vehicle's composite wing","authors":"Maciej Milewski , Jakub Wróbel , Artur Kierzkowski , David Vališ","doi":"10.1016/j.simpat.2025.103106","DOIUrl":"10.1016/j.simpat.2025.103106","url":null,"abstract":"<div><div>This paper investigates the structural dynamics of a UAV composite wing through FEM simulations and experimental modal analysis, aiming to replace traditional experimental testing in UAV structural evaluations. The simulations, performed with Ansys Composite Prep/Post (ACP), model each composite layer with specific fiber orientations, material properties, and thickness. Experimental tests, utilizing a shaker for excitation and an accelerometer for response measurement, were conducted on the aircraft in the frequency range of 0 to 1100 Hz, targeting operationally relevant harmonic frequencies. A comparative analysis between simulation and experimental results identifies sources of discrepancies, particularly in critical low-frequency modes essential for UAV performance. The study highlights how simplifications in the FEM model, such as excluding control surfaces and assuming material homogeneity, impact simulation accuracy. The paper concludes by outlining directions for further research, stressing the need to refine FEM models and enhance composite material representations to improve UAV reliability and simulation accuracy.</div></div>","PeriodicalId":49518,"journal":{"name":"Simulation Modelling Practice and Theory","volume":"142 ","pages":"Article 103106"},"PeriodicalIF":3.5,"publicationDate":"2025-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143683267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}