IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-31 DOI: 10.3390/e27040373

Xueyan Niu, Bo Bai, Nian Guo, Weixi Zhang, Wei Han

{"title":"Rate-Distortion-Perception Trade-Off in Information Theory, Generative Models, and Intelligent Communications.","authors":"Xueyan Niu, Bo Bai, Nian Guo, Weixi Zhang, Wei Han","doi":"10.3390/e27040373","DOIUrl":"https://doi.org/10.3390/e27040373","url":null,"abstract":"Traditional rate-distortion (RD) theory examines the trade-off between the average length of the compressed representation of a source and the additive distortions of its reconstruction. The rate-distortion-perception (RDP) framework, which integrates the perceptual dimension into the RD paradigm, has garnered significant attention due to recent advancements in machine learning, where perceptual fidelity is assessed by the divergence between input and reconstruction distributions. In communication systems where downstream tasks involve generative modeling, high perceptual fidelity is essential, despite distortion constraints. However, while zero distortion implies perfect realism, the converse is not true, highlighting an imbalance in the significance of distortion and perceptual constraints. This article clarifies that incorporating perceptual constraints does not decrease the necessary rate; instead, under certain conditions, additional rate is required, even with the aid of common and private randomness, which are key elements in generative models. Consequently, we project an increase in expected traffic in intelligent communication networks with the consideration of perceptual quality. Nevertheless, a modest increase in rate can enable generative models to significantly enhance the perceptual quality of reconstructions. By exploring the synergies between generative modeling and communication through the lens of information-theoretic results, this article demonstrates the benefits of intelligent communication systems and advocates for the application of the RDP framework in advancing compression and semantic communication research.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12025864/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143990757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Transient Thermal Energy Harvesting at a Single Temperature Using Nonlinearity. 基于非线性的单温度瞬态热能收集。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-31 DOI: 10.3390/e27040374

Tamzeed B Amin, James M Mangum, Md R Kabir, Syed M Rahman, Ashaduzzaman, Pradeep Kumar, Luis L Bonilla, Paul M Thibado

引用次数: 0

Action Recognition with 3D Residual Attention and Cross Entropy. 基于三维剩余注意和交叉熵的动作识别。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-31 DOI: 10.3390/e27040368

Yuhao Ouyang, Xiangqian Li

{"title":"Action Recognition with 3D Residual Attention and Cross Entropy.","authors":"Yuhao Ouyang, Xiangqian Li","doi":"10.3390/e27040368","DOIUrl":"https://doi.org/10.3390/e27040368","url":null,"abstract":"This study proposes a three-dimensional (3D) residual attention network (3DRFNet) for human activity recognition by learning spatiotemporal representations from motion pictures. Core innovation integrates the attention mechanism into the 3D ResNet framework to emphasize key features and suppress irrelevant ones. In each 3D ResNet block, channel and spatial attention mechanisms generate attention maps for tensor segments, which are then multiplied by the input feature mapping to emphasize key features. Additionally, the integration of Fast Fourier Convolution (FFC) enhances the network's capability to effectively capture temporal and spatial features. Simultaneously, we used the cross-entropy loss function to describe the difference between the predicted value and GT to guide the model's backpropagation. Subsequent experimental results have demonstrated that 3DRFNet achieved SOTA performance in human action recognition. 3DRFNet achieved accuracies of 91.7% and 98.7% on the HMDB-51 and UCF-101 datasets, respectively, which highlighted 3DRFNet's advantages in recognition accuracy and robustness, particularly in effectively capturing key behavioral features in videos using both attention mechanisms.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12025861/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143970327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Intrinsic Motivation as Constrained Entropy Maximization. 作为约束熵最大化的内在动机。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-31 DOI: 10.3390/e27040372

Alex B Kiefer

引用次数: 0

From Task Distributions to Expected Paths Lengths Distributions: Value Function Initialization in Sparse Reward Environments for Lifelong Reinforcement Learning. 从任务分布到期望路径长度分布：终身强化学习的稀疏奖励环境中的值函数初始化。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-30 DOI: 10.3390/e27040367

Soumia Mehimeh, Xianglong Tang

{"title":"From Task Distributions to Expected Paths Lengths Distributions: Value Function Initialization in Sparse Reward Environments for Lifelong Reinforcement Learning.","authors":"Soumia Mehimeh, Xianglong Tang","doi":"10.3390/e27040367","DOIUrl":"https://doi.org/10.3390/e27040367","url":null,"abstract":"This paper studies value function transfer within reinforcement learning frameworks, focusing on tasks continuously assigned to an agent through a probabilistic distribution. Specifically, we focus on environments characterized by sparse rewards with a terminal goal. Initially, we propose and theoretically demonstrate that the distribution of the computed value function from such environments, whether in cases where the goals or the dynamics are changing across tasks, can be reformulated as the distribution of the number of steps to the goal generated by their optimal policies, which we name the expected optimal path length. To test our propositions, we hypothesize that the distribution of the expected optimal path lengths resulting from the task distribution is normal. This claim leads us to propose that if the distribution is normal, then the distribution of the value function follows a log-normal pattern. Leveraging this insight, we introduce \"LogQInit\" as a novel value function transfer method, based on the properties of log-normality. Finally, we run experiments on a scenario of goals and dynamics distributions, validate our proposition by providing an a dequate analysis of the results, and demonstrate that LogQInit outperforms existing methods of value function initialization, policy transfer, and reward shaping.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12025380/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143970374","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Generalized Orthogonal de Bruijn and Kautz Sequences. 广义正交de Bruijn和Kautz序列。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-30 DOI: 10.3390/e27040366

Yuan-Pon Chen, Jin Sima, Olgica Milenkovic

{"title":"Generalized Orthogonal de Bruijn and Kautz Sequences.","authors":"Yuan-Pon Chen, Jin Sima, Olgica Milenkovic","doi":"10.3390/e27040366","DOIUrl":"https://doi.org/10.3390/e27040366","url":null,"abstract":"A de Bruijn sequence of order k over a finite alphabet is a cyclic sequence with the property that it contains every possible k-sequence as a substring exactly once. Orthogonal de Bruijn sequences are the collections of de Bruijn sequences of the same order, k, that satisfy the joint constraint that every (k+1)-sequence appears as a substring in, at most, one of the sequences in the collection. Both de Bruijn and orthogonal de Bruijn sequences have found numerous applications in synthetic biology, although the latter remain largely unexplored in the coding theory literature. Here, we study three relevant practical generalizations of orthogonal de Bruijn sequences, where we relax either the constraint that every (k+1)-sequence appears exactly once or the sequences themselves are de Bruijn rather than balanced de Bruijn sequences. We also provide lower and upper bounds on the number of fixed-weight orthogonal de Bruijn sequences. The paper concludes with parallel results for orthogonal nonbinary Kautz sequences, which satisfy similar constraints as de Bruijn sequences, except for being only required to cover all subsequences of length k whose maximum run length equals one.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12025929/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143958287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring the Evolution-Coupling Hypothesis: Do Enzymes' Performance Gains Correlate with Increased Dissipation? 探索进化耦合假说：酶的性能提高与耗散增加有关吗？

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-29 DOI: 10.3390/e27040365

Davor Juretić

{"title":"Exploring the Evolution-Coupling Hypothesis: Do Enzymes' Performance Gains Correlate with Increased Dissipation?","authors":"Davor Juretić","doi":"10.3390/e27040365","DOIUrl":"https://doi.org/10.3390/e27040365","url":null,"abstract":"The research literature presents divergent opinions regarding the role of dissipation in living systems, with views ranging from it being useless to it being essential for driving life. The implications of universal thermodynamic evolution are often overlooked or considered controversial. A higher rate of entropy production indicates faster thermodynamic evolution. We calculated enzyme-associated dissipation under steady-state conditions using minimalistic models of enzyme kinetics when all microscopic rate constants are known. We found that dissipation is roughly proportional to the turnover number, and a log-log power-law relationship exists between dissipation and the catalytic efficiency of enzymes. \"Perfect\" specialized enzymes exhibit the highest dissipation levels and represent the pinnacle of biological evolution. The examples that we analyzed suggested two key points: (a) more evolved enzymes excel in free-energy dissipation, and (b) the proposed evolutionary trajectory from generalist to specialized enzymes should involve increased dissipation for the latter. Introducing stochastic noise in the kinetics of individual enzymes may lead to optimal performance parameters that exceed the observed values. Our findings indicate that biological evolution has opened new channels for dissipation through specialized enzymes. We also discuss the implications of our results concerning scaling laws and the seamless coupling between thermodynamic and biological evolution in living systems immersed in out-of-equilibrium environments.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12025749/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143985864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Entropy Profiles for Li-Ion Batteries-Effects of Chemistries and Degradation. 锂离子电池的熵谱——化学和降解的影响。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-29 DOI: 10.3390/e27040364

Julia Wind, Preben J S Vie

{"title":"Entropy Profiles for Li-Ion Batteries-Effects of Chemistries and Degradation.","authors":"Julia Wind, Preben J S Vie","doi":"10.3390/e27040364","DOIUrl":"https://doi.org/10.3390/e27040364","url":null,"abstract":"This paper presents entropy measurements for a large set of commercial Li-ion cells. We present entropy data on full cells with a variety of common Li-ion cell electrode chemistries; graphite, hard carbon, lithium-titanium-oxide (LTO), lithium cobalt-oxide (LCO), nickel manganese cobalt oxides (NMC), nickel cobalt aluminium oxide (NCA), lithium iron-phosphate (LFP), as well as electrodes with mixes of these. All data were collected using an accelerated potentiometric method in steps of approximately 5% State-of-Charge (SoC) across the full SoC window. We observe that the entropy profiles depend on the chemistry of the Li-ion cells, but that they also vary between different commercial cells with the same chemistry. Entropy contributions are quantified with respect to both, their means, positive and negative contributions as well as their SoC variation. In addition, we present how different cyclic ageing temperatures change the entropy profiles for a selected commercial Li-ion cell through ageing. A clear difference in entropy profiles is observed after a capacity loss of 20%. This difference can be attributed to different ageing mechanisms within the Li-ion cells, leading to changes in the balancing of electrodes, as well as changes in the electrode materials.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12025376/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143992254","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Vector Flows That Compute the Capacity of Discrete Memoryless Channels. 计算离散无内存通道容量的矢量流。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-29 DOI: 10.3390/e27040362

Guglielmo Beretta, Marcello Pelillo

引用次数: 0

OMAL: A Multi-Label Active Learning Approach from Data Streams. OMAL：来自数据流的多标签主动学习方法。

IF 2.1 3区物理与天体物理

Entropy Pub Date : 2025-03-29 DOI: 10.3390/e27040363

Qiao Fang, Chen Xiang, Jicong Duan, Benallal Soufiyan, Changbin Shao, Xibei Yang, Sen Xu, Hualong Yu

{"title":"OMAL: A Multi-Label Active Learning Approach from Data Streams.","authors":"Qiao Fang, Chen Xiang, Jicong Duan, Benallal Soufiyan, Changbin Shao, Xibei Yang, Sen Xu, Hualong Yu","doi":"10.3390/e27040363","DOIUrl":"https://doi.org/10.3390/e27040363","url":null,"abstract":"With the rapid growth of digital computing, communication, and storage devices applied in various real-world scenarios, more and more data have been collected and stored to drive the development of machine learning techniques. It is also noted that the data that emerge in real-world applications tend to become more complex. In this study, we regard a complex data type, i.e., multi-label data, acquired with a time constraint in a dynamic online scenario. Under such conditions, constructing a learning model has to face two challenges: it requires dynamically adapting the variances in label correlations and imbalanced data distributions and it requires more labeling consumptions. To solve these two issues, we propose a novel online multi-label active learning (OMAL) algorithm that considers simultaneously adopting uncertainty (using the average entropy of prediction probabilities) and diversity (using the average cosine distance between feature vectors) as an active query strategy. Specifically, to focus on label correlations, we use a classifier chain (CC) as the multi-label learning model and design a label co-occurrence ranking strategy to arrange label sequence in CC. To adapt the naturally imbalanced distribution of the multi-label data, we select weight extreme learning machine (WELM) as the basic binary-class classifier in CC. The experimental results on ten benchmark multi-label datasets that were transformed into streams show that our proposed method is superior to several popular static multi-label active learning algorithms in terms of both the Macro-F1 and Micro-F1 metrics, indicating its specifical adaptions in the dynamic data stream environment.","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"27 4","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12026165/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143968486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Entropy最新文献