{"title":"On the Complete Monotonicity of Rényi Entropy","authors":"Hao Wu;Lei Yu;Laigang Guo","doi":"10.1109/TIT.2025.3561384","DOIUrl":null,"url":null,"abstract":"In this paper, we investigate the complete monotonicity of Rényi entropy along the heat flow. We confirm this property for the order of derivative up to 4, when the order of Rényi entropy is in certain regimes. We also investigate concavity of Rényi entropy power and the complete monotonicity of Tsallis entropy. We recover and slightly extend Hung’s result on the fourth-order derivative of the Tsallis entropy, and observe that the complete monotonicity holds for Tsallis entropy of order 2, which is equivalent to that the noise stability with respect to the heat semigroup is completely monotone. Based on this observation, we conjecture that the complete monotonicity holds for Tsallis entropy of all orders <inline-formula> <tex-math>$\\alpha \\in (1,2)$ </tex-math></inline-formula>. Our proofs in this paper are based on the techniques of integration-by-parts, sum-of-squares, and curve-fitting.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 7","pages":"4895-4914"},"PeriodicalIF":2.2000,"publicationDate":"2025-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Information Theory","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10966505/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
In this paper, we investigate the complete monotonicity of Rényi entropy along the heat flow. We confirm this property for the order of derivative up to 4, when the order of Rényi entropy is in certain regimes. We also investigate concavity of Rényi entropy power and the complete monotonicity of Tsallis entropy. We recover and slightly extend Hung’s result on the fourth-order derivative of the Tsallis entropy, and observe that the complete monotonicity holds for Tsallis entropy of order 2, which is equivalent to that the noise stability with respect to the heat semigroup is completely monotone. Based on this observation, we conjecture that the complete monotonicity holds for Tsallis entropy of all orders $\alpha \in (1,2)$ . Our proofs in this paper are based on the techniques of integration-by-parts, sum-of-squares, and curve-fitting.
期刊介绍:
The IEEE Transactions on Information Theory is a journal that publishes theoretical and experimental papers concerned with the transmission, processing, and utilization of information. The boundaries of acceptable subject matter are intentionally not sharply delimited. Rather, it is hoped that as the focus of research activity changes, a flexible policy will permit this Transactions to follow suit. Current appropriate topics are best reflected by recent Tables of Contents; they are summarized in the titles of editorial areas that appear on the inside front cover.