Entropy最新文献_第3页

Dynamics of Aggregation in Systems of Self-Propelled Rods. 自走棒系统中的聚合动力学。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-15 DOI: 10.3390/e26110980

Richard J G Löffler, Jerzy Gorecki

引用次数: 0

Bowen's Formula for a Dynamical Solenoid. 动态电磁铁的鲍恩公式。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-15 DOI: 10.3390/e26110979

Andrzej Biś, Wojciech Kozłowski, Agnieszka Marczuk

引用次数: 0

Exploring the Impact of Additive Shortcuts in Neural Networks via Information Bottleneck-like Dynamics: From ResNet to Transformer. 通过信息瓶颈样动力学探索神经网络中加法捷径的影响：从 ResNet 到变压器

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-14 DOI: 10.3390/e26110974

Zhaoyan Lyu, Miguel R D Rodrigues

{"title":"Exploring the Impact of Additive Shortcuts in Neural Networks via Information Bottleneck-like Dynamics: From ResNet to Transformer.","authors":"Zhaoyan Lyu, Miguel R D Rodrigues","doi":"10.3390/e26110974","DOIUrl":"10.3390/e26110974","url":null,"abstract":"Deep learning has made significant strides, driving advances in areas like computer vision, natural language processing, and autonomous systems. In this paper, we further investigate the implications of the role of additive shortcut connections, focusing on models such as ResNet, Vision Transformers (ViTs), and MLP-Mixers, given that they are essential in enabling efficient information flow and mitigating optimization challenges such as vanishing gradients. In particular, capitalizing on our recent information bottleneck approach, we analyze how additive shortcuts influence the fitting and compression phases of training, crucial for generalization. We leverage Z-X and Z-Y measures as practical alternatives to mutual information for observing these dynamics in high-dimensional spaces. Our empirical results demonstrate that models with identity shortcuts (ISs) often skip the initial fitting phase and move directly into the compression phase, while non-identity shortcut (NIS) models follow the conventional two-phase process. Furthermore, we explore how IS models are still able to compress effectively, maintaining their generalization capacity despite bypassing the early fitting stages. These findings offer new insights into the dynamics of shortcut connections in neural networks, contributing to the optimization of modern deep learning architectures.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592645/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Sensitivity of Bayesian Networks to Errors in Their Structure. 贝叶斯网络对其结构错误的敏感性。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-14 DOI: 10.3390/e26110975

Agnieszka Onisko, Marek J Druzdzel

{"title":"Sensitivity of Bayesian Networks to Errors in Their Structure.","authors":"Agnieszka Onisko, Marek J Druzdzel","doi":"10.3390/e26110975","DOIUrl":"10.3390/e26110975","url":null,"abstract":"There is a widespread belief in the Bayesian network (BN) community that while the overall accuracy of the results of BN inference is not sensitive to the precision of parameters, it is sensitive to the structure. We report on the results of a study focusing on the parameters in a companion paper, while this paper focuses on the BN graphical structure. We present the results of several experiments in which we test the impact of errors in the BN structure on its accuracy in the context of medical diagnostic models. We study the deterioration in model accuracy under structural changes that systematically modify the original gold standard model, notably the node and edge removal and edge reversal. Our results confirm the popular belief that the BN structure is important, and we show that structural errors may lead to a serious deterioration in the diagnostic accuracy. At the same time, most BN models are forgiving to single errors. In light of these results and the results of the companion paper, we recommend that knowledge engineers focus their efforts on obtaining a correct model structure and worry less about the overall precision of parameters.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592709/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Robustness Analysis of Multilayer Infrastructure Networks Based on Incomplete Information Stackelberg Game: Considering Cascading Failures. 基于不完全信息堆栈博弈的多层基础设施网络鲁棒性分析：考虑级联故障。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-14 DOI: 10.3390/e26110976

Haitao Li, Lixin Ji, Yingle Li, Shuxin Liu

{"title":"Robustness Analysis of Multilayer Infrastructure Networks Based on Incomplete Information Stackelberg Game: Considering Cascading Failures.","authors":"Haitao Li, Lixin Ji, Yingle Li, Shuxin Liu","doi":"10.3390/e26110976","DOIUrl":"10.3390/e26110976","url":null,"abstract":"The growing importance of critical infrastructure systems (CIS) makes maintaining their normal operation against deliberate attacks such as terrorism a significant challenge. Combining game theory and complex network theory provides a framework for analyzing CIS robustness in adversarial scenarios. Most existing studies focus on single-layer networks, while CIS are better modeled as multilayer networks. Research on multilayer network games is limited, lacking methods for constructing incomplete information through link hiding and neglecting the impact of cascading failures. We propose a multilayer network Stackelberg game model with incomplete information considering cascading failures (MSGM-IICF). First, we describe the multilayer network model and define the multilayer node-weighted degree. Then, we present link hiding rules and a cascading failure model. Finally, we construct MSGM-IICF, providing methods for calculating payoff functions from the different perspectives of attackers and defenders. Experiments on synthetic and real-world networks demonstrate that link hiding improves network robustness without considering cascading failures. However, when cascading failures are considered, they become the primary factor determining network robustness. Dynamic capacity allocation enhances network robustness, while changes in dynamic costs make the network more vulnerable. The proposed method provides a new way of analyzing the robustness of diverse CIS, supporting resilient CIS design.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592955/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727226","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

DUS Topp-Leone-G Family of Distributions: Baseline Extension, Properties, Estimation, Simulation and Useful Applications. DUS Topp-Leone-G 分布系列：基线扩展、特性、估算、模拟和实用应用

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-13 DOI: 10.3390/e26110973

Divine-Favour N Ekemezie, Kizito E Anyiam, Mohammed Kayid, Oluwafemi Samson Balogun, Okechukwu J Obulezi

{"title":"DUS Topp-Leone-G Family of Distributions: Baseline Extension, Properties, Estimation, Simulation and Useful Applications.","authors":"Divine-Favour N Ekemezie, Kizito E Anyiam, Mohammed Kayid, Oluwafemi Samson Balogun, Okechukwu J Obulezi","doi":"10.3390/e26110973","DOIUrl":"10.3390/e26110973","url":null,"abstract":"This study introduces the DUS Topp-Leone family of distributions, a novel extension of the Topp-Leone distribution enhanced by the DUS transformer. We derive the cumulative distribution function (CDF) and probability density function (PDF), demonstrating the distribution's flexibility in modeling various lifetime phenomena. The DUS-TL exponential distribution was studied as a sub-model, with analytical and graphical evidence revealing that it exhibits a unique unimodal shape, along with fat-tail characteristics, making it suitable for time-to-event data analysis. We evaluate parameter estimation methods, revealing that non-Bayesian approaches, particularly Maximum Likelihood and Least Squares, outperform Bayesian techniques in terms of bias and root mean square error. Additionally, the distribution effectively models datasets with varying skewness and kurtosis values, as illustrated by its application to total factor productivity data across African countries and the mortality rate of people who injected drugs. Overall, the DUS Topp-Leone family represents a significant advancement in statistical modeling, offering robust tools for researchers in diverse fields.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11593243/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An Instructive CO₂ Adsorption Model for DAC: Wave Solutions and Optimal Processes. 用于 DAC 的二氧化碳吸附教学模型：波浪解决方案和最佳流程。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-13 DOI: 10.3390/e26110972

Emily Kay-Leighton, Henning Struchtrup

引用次数: 0

Dirac Equation and Fisher Information. 狄拉克方程与费雪信息

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-12 DOI: 10.3390/e26110971

Asher Yahalom

引用次数: 0

Complexity and Variation in Infectious Disease Birth Cohorts: Findings from HIV+ Medicare and Medicaid Beneficiaries, 1999-2020. 传染病出生队列的复杂性和差异性：1999-2020年HIV+医疗保险和医疗补助受益人的研究结果。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-12 DOI: 10.3390/e26110970

Nick Williams

{"title":"Complexity and Variation in Infectious Disease Birth Cohorts: Findings from HIV+ Medicare and Medicaid Beneficiaries, 1999-2020.","authors":"Nick Williams","doi":"10.3390/e26110970","DOIUrl":"10.3390/e26110970","url":null,"abstract":"The impact of uncertainty in information systems is difficult to assess, especially when drawing conclusions from human observation records. In this study, we investigate survival variation in a population experiencing infectious disease as a proxy to investigate uncertainty problems. Using Centers for Medicare and Medicaid Services claims, we discovered 1,543,041 HIV+ persons, 363,425 of whom were observed dying from all-cause mortality. Once aggregated by HIV status, year of birth and year of death, Age-Period-Cohort disambiguation and regression models were constructed to produce explanations of variance in survival. We used Age-Period-Cohort as an alternative method to work around under-observed features of uncertainty like infection transmission, receiver host dynamics or comorbidity noise impacting survival variation. We detected ages that have a consistent, disproportionate share of deaths independent of study year or year of birth. Variation in seasonality of mortality appeared stable in regression models; in turn, HIV cases in the United States do not have a survival gain when uncertainty is uncontrolled for. Given the information complexity issues under observed exposure and transmission, studies of infectious diseases should either include robust decedent cases, observe transmission physics or avoid drawing conclusions about survival from human observation records.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592912/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Universality of Dynamical Symmetries in Chaotic Maps. 混沌地图中动态对称的普遍性

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2024-11-12 DOI: 10.3390/e26110969

Marcos Acero, Sean Lyons, Andrés Aragoneses, Arjendu K Pattanayak

引用次数: 0