EntropyPub Date : 2025-06-27DOI: 10.3390/e27070687
Ralph D Lorenz
{"title":"The Lucky Engine: Probabilistic Emergence and Persistence of Near-Maximum Dissipation States.","authors":"Ralph D Lorenz","doi":"10.3390/e27070687","DOIUrl":"10.3390/e27070687","url":null,"abstract":"<p><p>A paradigm, wherein a nonequilibrium system has multiple modes of transport that can act in combination, permits the resolution of several difficulties with the notion of maximum entropy production (MaxEP or MEP). First, physical constraints, such as the density of the atmosphere or the planetary rotation rate, merely define the portfolio of modes that can be engaged by the system: physically impossible states cannot be selected. Second, with minimal sensitivity to how the system evolves, it is seen that there are simply more numerous quasi-steady microstates (combinations of modes) that are near the maximum of work output (or dissipation rate or EP) than there are far from it, and so it is more probable that the system will be observed to be near that maximum. Third, this paradigm naturally permits exploration of the system behavior when subjected to non-steady forcing. Finally, it provides a framework to explain when a system has 'enough' degrees of freedom to attain a maximum dissipation state, as opposed to the minimum dissipation state expected for certain constrained systems.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294728/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728925","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-27DOI: 10.3390/e27070690
Xiaoping Yuan, Qianqian Zheng
{"title":"Impact of Calcium and Potassium Currents on Spiral Wave Dynamics in the LR1 Model.","authors":"Xiaoping Yuan, Qianqian Zheng","doi":"10.3390/e27070690","DOIUrl":"10.3390/e27070690","url":null,"abstract":"<p><p>Spiral wave dynamics in cardiac tissue are critically implicated in the pathogenesis of arrhythmias. This study investigates the effects of modulating calcium and potassium currents on spiral wave stability in a two-dimensional cardiac model. The gate variable that dynamically regulates the opening probability of ion channels also plays a significant role in the control of the spiral wave dynamics. We demonstrate that reducing gate variables accelerates wave propagation, thins spiral arms, and shortens action potential duration, ultimately inducing dynamic instability. Irregular electrocardiogram (ECG) patterns and altered action potential morphology further suggest an enhanced arrhythmogenic potential. These findings elucidate the ionic mechanisms underlying spiral wave breakup, providing both theoretical insights and practical implications for the development of targeted arrhythmia treatments.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12295187/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-27DOI: 10.3390/e27070692
Pasquale Digregorio, Claudio Basilio Caporusso, Lucio Mauro Carenza, Giuseppe Gonnella, Daniela Moretti, Giuseppe Negro, Massimiliano Semeraro, Antonio Suma
{"title":"Transverse Self-Propulsion Enhances the Aggregation of Active Dumbbells.","authors":"Pasquale Digregorio, Claudio Basilio Caporusso, Lucio Mauro Carenza, Giuseppe Gonnella, Daniela Moretti, Giuseppe Negro, Massimiliano Semeraro, Antonio Suma","doi":"10.3390/e27070692","DOIUrl":"10.3390/e27070692","url":null,"abstract":"<p><p>We investigate a two-dimensional system of active Brownian dumbbells using molecular dynamics simulations. In this model, each dumbbell is driven by an active force oriented perpendicular to the axis connecting its two constituent beads. We characterize the resulting phase behavior and find that, across all values of activity, the system undergoes phase separation between dilute and dense phases. The dense phase exhibits hexatic order, and for large enough activity, we observe a marked increase in local polarization, with dumbbells predominantly oriented towards the interior of the clusters. Compared to the case of axially self-propelled dumbbells, we find that the binodal region is enlarged towards lower densities at all activities. This shift arises because dumbbells with transverse propulsion can more easily form stable cluster cores, serving as nucleation seeds, and show a highly suppressed escaping rate from the cluster boundary. Finally, we observe that clusters exhibit spontaneous rotation, with the modulus of the angular velocity scaling as ω∼rg-2, where rg is the cluster's radius of gyration. This contrasts with axially propelled dumbbells, where the scaling follows ω∼rg-1. We develop a simplified analytical model to rationalize this scaling behavior.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294323/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728930","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-27DOI: 10.3390/e27070688
José M Amigó, Fernando Montani
{"title":"Nonlinear Dynamics and Applications.","authors":"José M Amigó, Fernando Montani","doi":"10.3390/e27070688","DOIUrl":"10.3390/e27070688","url":null,"abstract":"<p><p>Nonlinear dynamics is the study of dynamical systems in finite dimensions, whether in discrete or continuous time, in which the evolution equation (a difference or differential equation, respectively) is not linear in the state variables [...].</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294171/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Jointly Optimizing Resource Allocation, User Scheduling, and Grouping in SBMA Networks: A PSO Approach.","authors":"Jianjian Wu, Chanzi Liu, Xindi Wang, Chi-Tsun Cheng, Qingfeng Zhou","doi":"10.3390/e27070691","DOIUrl":"10.3390/e27070691","url":null,"abstract":"<p><p>Blind Interference Alignment (BIA) and Sparse Code Multiple Access (SCMA) offer the potential for massive connectivity but face limitations. Our recently proposed Sparsecode-and-BIA-based Multiple Access (SBMA) scheme synergizes their strengths, promising enhanced performance. SBMA leverages flexible user grouping (UG) strategies to effectively manage its unique combination of sparse code constraints and interference alignment requirements, thereby facilitating the fulfillment of diverse Quality of Service (QoS) demands. However, realizing SBMA's full potential requires efficient joint resource allocation (RA), user scheduling (US), and user grouping (UG). The inherent coupling of these factors within the SBMA framework complicates this task significantly, rendering RA/US solutions designed purely for SCMA or BIA insufficient. This paper addresses this critical open issue. We first formulate the joint RA, US, and UG problems specifically for SBMA systems as an integer optimization task, aiming to maximize the number of users meeting QoS requirements. To tackle this NP-hard problem, we propose an effective algorithm based on Particle Swarm Optimization (PSO), featuring a carefully designed update function tailored specifically for the joint US and UG decisions required in SBMA. Comprehensive simulations demonstrate show that the proposed algorithm significantly outperforms the random-based scheme. Under certain conditions, it serves approximately 280% more users who meet their QoS requirements in high-SNR scenarios.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294732/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-26DOI: 10.3390/e27070680
Qiuying Chen, Zhiming Li, Zhi Li
{"title":"An Aliasing Measure of Factor Effects in Three-Level Regular Designs.","authors":"Qiuying Chen, Zhiming Li, Zhi Li","doi":"10.3390/e27070680","DOIUrl":"10.3390/e27070680","url":null,"abstract":"<p><p>For three-level regular designs, the confounding from the perspectives of both factor and component effects leads to different results. The aliasing properties of factor effects are more significant than the latter in the experimental model. In this paper, a new three-level aliasing pattern is proposed to evaluate the degree of aliasing among different factors. Based on the classification pattern, a new criterion is introduced for choosing optimal three-level regular designs. Then, we analyze the relationship between the criterion and the existing criteria, including general minimum lower-order confounding, entropy, minimum aberration, and clear effects. The results show that the classification patterns of other criteria can be expressed as functions of our proposed pattern. Further, an aliasing algorithm is provided, and all 27-run, some of the 81-run, and 243-run three-level designs are listed in tables and compared with the rankings under other criteria. A real example is provided to illustrate the proposed methods.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12293866/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-26DOI: 10.3390/e27070682
Seyedeh Azadeh Fallah Mortezanejad, Ruochen Wang, Ali Mohammad-Djafari
{"title":"Physics-Informed Neural Networks with Unknown Partial Differential Equations: An Application in Multivariate Time Series.","authors":"Seyedeh Azadeh Fallah Mortezanejad, Ruochen Wang, Ali Mohammad-Djafari","doi":"10.3390/e27070682","DOIUrl":"10.3390/e27070682","url":null,"abstract":"<p><p>A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: How can models utilize physics or mathematical principles to enhance predictions when dealing with sparse, noisy, or incomplete data? Physics-Informed Neural Networks (PINNs) put this idea into practice by incorporating a forward model, such as Partial Differential Equations (PDEs), as soft constraints. This guidance helps the networks find solutions that align with established laws. Recently, researchers have expanded this framework to include Bayesian NNs (BNNs) which allow for uncertainty quantification. However, what happens when the governing equations of a system are not completely known? In this work, we introduce methods to automatically select PDEs from historical data in a parametric family. We then integrate these learned equations into three different modeling approaches: PINNs, Bayesian-PINNs (B-PINNs), and Physical-Informed Bayesian Linear Regression (PI-BLR). To assess these frameworks, we evaluate them on a real-world Multivariate Time Series (MTS) dataset related to electrical power energy management. We compare their effectiveness in forecasting future states under different scenarios: with and without PDE constraints and accuracy considerations. This research aims to bridge the gap between data-driven discovery and physics-guided learning, providing valuable insights for practical applications.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294105/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-26DOI: 10.3390/e27070684
Chenguang Lu
{"title":"Improving the Minimum Free Energy Principle to the Maximum Information Efficiency Principle.","authors":"Chenguang Lu","doi":"10.3390/e27070684","DOIUrl":"10.3390/e27070684","url":null,"abstract":"<p><p>Friston proposed the Minimum Free Energy Principle (FEP) based on the Variational Bayesian (VB) method. This principle emphasizes that the brain and behavior coordinate with the environment, promoting self-organization. However, it has a theoretical flaw, a possibility of being misunderstood, and a limitation (only likelihood functions are used as constraints). This paper first introduces the semantic information G theory and the <i>R</i>(<i>G</i>) function (where <i>R</i> is the minimum mutual information for the given semantic mutual information <i>G</i>). The G theory is based on the P-T probability framework and, therefore, allows for the use of truth, membership, similarity, and distortion functions (related to semantics) as constraints. Based on the study of the <i>R</i>(<i>G</i>) function and logical Bayesian Inference, this paper proposes the Semantic Variational Bayesian (SVB) and the Maximum Information Efficiency (MIE) principle. Theoretic analysis and computing experiments prove that <i>R</i> - <i>G</i> = <i>F</i> - <i>H</i>(<i>X</i>|<i>Y</i>) (where <i>F</i> denotes VFE, and <i>H</i>(<i>X</i>|<i>Y</i>) is Shannon conditional entropy) instead of <i>F</i> continues to decrease when optimizing latent variables; SVB is a reliable and straightforward approach for latent variables and active inference. This paper also explains the relationship between information, entropy, free energy, and VFE in local non-equilibrium and equilibrium systems, concluding that Shannon information, semantic information, and VFE are analogous to the increment of free energy, the increment of exergy, and physical conditional entropy. The MIE principle builds upon the fundamental ideas of the FEP, making them easier to understand and apply. It needs to combine deep learning methods for wider applications.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12293917/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2025-06-26DOI: 10.3390/e27070685
Yanhong Bai, Xingjiao Wu, Tingjiang Wei, Liang He
{"title":"A Dual-Encoder Contrastive Learning Model for Knowledge Tracing.","authors":"Yanhong Bai, Xingjiao Wu, Tingjiang Wei, Liang He","doi":"10.3390/e27070685","DOIUrl":"10.3390/e27070685","url":null,"abstract":"<p><p>Knowledge tracing (KT) models learners' evolving knowledge states to predict future performance, serving as a fundamental component in personalized education systems. However, existing methods suffer from data sparsity challenges, resulting in inadequate representation quality for low-frequency knowledge concepts and inconsistent modeling of students' actual knowledge states. To address this challenge, we propose Dual-Encoder Contrastive Knowledge Tracing (DECKT), a contrastive learning framework that improves knowledge state representation under sparse data conditions. DECKT employs a momentum-updated dual-encoder architecture where the primary encoder processes current input data while the momentum encoder maintains stable historical representations through exponential moving average updates. These encoders naturally form contrastive pairs through temporal evolution, effectively enhancing representation capabilities for low-frequency knowledge concepts without requiring destructive data augmentation operations that may compromise knowledge structure integrity. To preserve semantic consistency in learned representations, DECKT incorporates a graph structure constraint loss that leverages concept-question relationships to maintain appropriate similarities between related concepts in the embedding space. Furthermore, an adversarial training mechanism applies perturbations to embedding vectors, enhancing model robustness and generalization. Extensive experiments on benchmark datasets demonstrate that DECKT significantly outperforms existing state-of-the-art methods, validating the effectiveness of the proposed approach in alleviating representation challenges in sparse educational data.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294018/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Forecast Model for COVID-19 Spread Trends Using Blog and GPS Data from Smartphones.","authors":"Ryosuke Susuta, Kenta Yamada, Hideki Takayasu, Misako Takayasu","doi":"10.3390/e27070686","DOIUrl":"10.3390/e27070686","url":null,"abstract":"<p><p>This study investigates the feasibility of using GPS data and frequency of COVID-19-related blog words to forecast new infection trends through a linear regression analysis. By employing time series' trend decomposition and Spearman's rank correlation, we identify and select a set of significant variables from the GPS and blog data to construct two models: a fixed-period model and a sequential adaptive model that updates with each new wave of infections. Our findings reveal that the adaptive model more effectively captures long-term trends, achieving approximately 90% accuracy in forecasting infection rates seven days in advance. Despite challenges in forecasting exact values, this research demonstrates that combining GPS and blog data through a dynamic, wave-based learning model offers a promising direction for enhancing the forecasting accuracy of COVID-19 spread. This approach has significant implications for public health preparedness.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 7","pages":""},"PeriodicalIF":2.0,"publicationDate":"2025-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12294336/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144728813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}