{"title":"A Novel Information Complexity Approach to Score Receiver Operating Characteristic (ROC) Curve Modeling.","authors":"Aylin Gocoglu, Neslihan Demirel, Hamparsum Bozdogan","doi":"10.3390/e26110988","DOIUrl":"10.3390/e26110988","url":null,"abstract":"<p><p>Performance metrics are measures of success or performance that can be used to evaluate how well a model makes accurate predictions or classifications. However, there is no single measure since each performance metric emphasizes a different classification aspect. Model selection procedures based on information criteria offer a quantitative measure that balances model complexity with goodness of fit, providing a better alternative to classical approaches. In this paper, we introduce and develop a novel Information Complexity-Receiver Operating Characteristic, abbreviated as ICOMP-ROC, criterion approach to fit and study the performance of ROC curve models. We construct and derive the Universal ROC (UROC) for a combination of sixteen Bi-distributional ROC models to choose the best Bi-distributional ROC by minimizing the ICOMP-ROC criterion. We conduct large-scale Monte Carlo simulations using the sixteen Bi-distributional ROC models with the Normal-Normal and Weibull-Gamma pairs as the pseudo-true ROC models. We report the frequency of hits of the ICOMP-ROC criterion, showing its remarkable recovery rate. In addition to Bi-distributional fitting, we consider a high-dimensional real Magnetic Resonance Imaging (MRI) of the Brain dataset and Wisconsin Breast Cancer (WBC) dataset to study the performance of the common performance metrics and the ICOMP-ROC criterion using several machine learning (ML) classification algorithms. We use the genetic algorithm (GA) to reduce the dimensions of these two datasets to choose the best subset of the features to study and compare the performance of the newly proposed ICOMP-ROC criterion along with the traditional performance metrics. The choice of a suitable metric is not just contingent upon the ML model used, but it also depends upon the complexity and high dimensionality of the input datasets, since the traditional performance metrics give different results and have inherent limitations. Our numerical results show the consistency and reliability of the ICOMP-ROC criterion over the traditional performance metrics as a clever model selection criterion to choose the best fitting Bi-distributional ROC model and the best classification algorithm among the ones considered. This shows the utility and the versatility of our newly proposed approach in ROC curve modeling that integrates and robustifies currently used procedures.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592642/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142726664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-17DOI: 10.3390/e26110986
Asher Yahalom
{"title":"Gravitational Hamiltonian Systems and the Retarded Gravity Inequality.","authors":"Asher Yahalom","doi":"10.3390/e26110986","DOIUrl":"10.3390/e26110986","url":null,"abstract":"<p><p>Gravity and electromagnetic interactions are the only fundamental physical interactions (outside the nuclear domain). In this work, we shall concentrate on Hamiltonians containing gravitational interaction, which according to general relativity must be retarded. In recent years, retarded gravity has explained many of the mysteries surrounding the \"missing mass\" related to galactic rotation curves, the Tully-Fisher relations, and gravitational lensing phenomena. Indeed, a recent paper analyzing 143 galaxies has demonstrated that retarded gravity will suffice to explain galaxies' rotation curves without the need to postulate dark matter for multiple types of galaxies. Moreover, it also demystified the \"missing mass\" related to galactic clusters and elliptic galaxies in which excess matter was derived through the virial theorem. Here, we give a mathematical criterion that specifies the cases in which retardation is important for gravity (and when it is not). The criterion takes the form of an inequality.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592777/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-17DOI: 10.3390/e26110987
Jinkai Tian, Wenjing Yang
{"title":"Toward Transparent and Controllable Quantum Generative Models.","authors":"Jinkai Tian, Wenjing Yang","doi":"10.3390/e26110987","DOIUrl":"10.3390/e26110987","url":null,"abstract":"<p><p>Quantum generative models have shown promise in fields such as quantum chemistry, materials science, and optimization. However, their practical utility is hindered by a significant challenge: the lack of interpretability. In this work, we introduce <i>model inversion</i> to enhance both the interpretability and controllability of quantum generative models. Model inversion allows for tracing generated quantum states back to their latent variables, revealing the relationship between input parameters and generated outputs. We apply this method to models generating ground states for Hamiltonians, such as the transverse-field Ising model (TFIM) and generalized cluster Hamiltonians, achieving interpretability control without retraining the model. Experimental results demonstrate that our approach can accurately guide the generated quantum states across different quantum phases. This framework bridges the gap between theoretical models and practical applications by providing transparency and fine-tuning capabilities, particularly in high-stakes environments like drug discovery and material design.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592412/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-17DOI: 10.3390/e26110985
Kieran Drury, Jim Q Smith
{"title":"Dynamic Bayesian Networks, Elicitation, and Data Embedding for Secure Environments.","authors":"Kieran Drury, Jim Q Smith","doi":"10.3390/e26110985","DOIUrl":"10.3390/e26110985","url":null,"abstract":"<p><p>Serious crime modelling typically needs to be undertaken securely behind a firewall where police knowledge and capabilities remain undisclosed. Data informing an ongoing incident are often sparse; a large proportion of relevant data only come to light after the incident culminates or after police intervene-by which point it is too late to make use of the data to aid real-time decision-making for the incident in question. Much of the data that <i>are</i> available to the police to support real-time decision-making are highly confidential and cannot be shared with academics, and are therefore missing to them. In this paper, we describe the development of a formal protocol where a graphical model is used as a framework for securely translating a base model designed by an academic team to a fully embellished model for use by a police team. We then show, for the first time, how <i>libraries</i> of these models can be built and used for real-time decision support to circumvent the challenges of data missingness seen in such a secure environment through the ability to match ongoing plots to existing models within the library.The parallel development described by this protocol ensures that any sensitive information collected by police and missing to academics remains secured behind a firewall. The protocol nevertheless guides police so that they are able to combine the typically incomplete data streams that are open source with their more sensitive information in a formal and justifiable way. We illustrate the application of this protocol by describing how a new entry-a suspected vehicle attack-can be embedded into such a police library of criminal plots.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592506/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-16DOI: 10.3390/e26110984
Chang Sub Kim
{"title":"Bayesian Mechanics of Synaptic Learning Under the Free-Energy Principle.","authors":"Chang Sub Kim","doi":"10.3390/e26110984","DOIUrl":"10.3390/e26110984","url":null,"abstract":"<p><p>The brain is a biological system comprising nerve cells and orchestrates its embodied agent's perception, behavior, and learning in dynamic environments. The free-energy principle (FEP) advocated by Karl Friston explicates the local, recurrent, and self-supervised cognitive dynamics of the brain's higher-order functions. In this study, we continue to refine the FEP through a physics-guided formulation; specifically, we apply our theory to synaptic learning by considering it an inference problem under the FEP and derive the governing equations, called Bayesian mechanics. Our study uncovers how the brain infers weight changes and postsynaptic activity, conditioned on the presynaptic input, by deploying generative models of the likelihood and prior belief. Consequently, we exemplify the synaptic efficacy in the brain with a simple model; in particular, we illustrate that the brain organizes an optimal trajectory in neural phase space during synaptic learning in continuous time, which variationally minimizes synaptic surprisal.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592945/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-15DOI: 10.3390/e26110983
Osamu Hirota, Masaki Sohma
{"title":"Quantum Stream Cipher Based on Holevo-Yuen Theory: Part II.","authors":"Osamu Hirota, Masaki Sohma","doi":"10.3390/e26110983","DOIUrl":"10.3390/e26110983","url":null,"abstract":"<p><p>This paper discusses the foundation of security theory for the Quantum stream cipher based on the Holevo-Yuen theory, which allows the use of \"optical amplifiers\". This type of cipher is a technology that provides information-theoretic security (ITS) to optical data transmission by randomizing ultrafast optical communication signals with quantum noise. In general, the quantitative security of ITS is evaluated in terms of the unicity distance in Shannon theory. However, the quantum version requires modeling beyond the Shannon model of a random cipher to utilize the characteristics of the physical layer. Therefore, as the first step, one has to develop a generalized unicity distance theory and apply it to the evaluation of security. Although a complete theoretical formulation has not yet been established, this paper explains a primitive structure of a generalization of the Shannon random cipher and shows that the realization of this is the generalized quantum stream cipher. In addition, we present several implementation methods of generalized quantum stream ciphers and their security.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11593138/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-15DOI: 10.3390/e26110982
Si-Yeon Pak, Hyo-Won Kim, DaeHan Ahn, Jin-Ho Chung
{"title":"New Variable-Weight Optical Orthogonal Codes with Weights 3 to 5.","authors":"Si-Yeon Pak, Hyo-Won Kim, DaeHan Ahn, Jin-Ho Chung","doi":"10.3390/e26110982","DOIUrl":"10.3390/e26110982","url":null,"abstract":"<p><p>In optical networks, designing optical orthogonal codes (OOCs) with appropriate parameters is essential for enhancing the overall system performance. They are divided into two categories, constant-weight OOCs (CW-OOCs) and variable-weight OOCs (VW-OOCs), based on the number of distinct Hamming weights present in their codewords. This paper introduces a method for constructing VW-OOCs of length kp by using the structure of an integer ring and the Chinese Remainder Theorem. In particular, we present some specific VW-OOCs with weights of 3, 4, or 5. The results demonstrate that certain optimal VW-OOCs can be obtained with parameters that are not covered in the existing literature.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592724/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142726663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-15DOI: 10.3390/e26110978
Hongli Yang, Guohui Yu, Ivan Ganchev Ivanov
{"title":"Quantum Control Design by Lyapunov Trajectory Tracking and Optimal Control.","authors":"Hongli Yang, Guohui Yu, Ivan Ganchev Ivanov","doi":"10.3390/e26110978","DOIUrl":"10.3390/e26110978","url":null,"abstract":"<p><p>In this paper, we investigate a Lyapunov trajectory tracking design method that incorporates a Schrödinger equation with a dipole subterm and polarizability. Our findings suggest that the proposed control law can overcome the limitations of certain existing control laws that do not converge. By integrating a quadratic performance index, we introduce an optimal control law, which we subsequently analyze for stability and optimality. We also simulate the spin-1/2 particle system to illustrate our results. These findings are further validated through numerical illustrations involving a 3D, 5D system, and a spin-1/2 particle system.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592483/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-15DOI: 10.3390/e26110977
Miguel Citeli de Freitas, Viktor V Dodonov
{"title":"Statistical Properties of Superpositions of Coherent Phase States with Opposite Arguments.","authors":"Miguel Citeli de Freitas, Viktor V Dodonov","doi":"10.3390/e26110977","DOIUrl":"10.3390/e26110977","url":null,"abstract":"<p><p>We calculate the second-order moments, the Robertson-Schrödinger uncertainty product, and the Mandel factor for various superpositions of coherent phase states with opposite arguments, comparing the results with similar superpositions of the usual (Klauder-Glauber-Sudarshan) coherent states. We discover that the coordinate variance in the analog of even coherent states can show the most strong squeezing effect, close to the maximal possible squeezing for the given mean photon number. On the other hand, the Robertson-Schrödinger (RS) uncertainty product in superpositions of coherent phase states increases much slower (as function of the mean photon number) than in superpositions of the usual coherent states. A nontrivial behavior of the Mandel factor for small mean photon numbers is discovered in superpositions with unequal weights of two components. An exceptional nature of the even and odd superpositions is demonstrated.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11593266/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142727240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
EntropyPub Date : 2024-11-15DOI: 10.3390/e26110981
Akihiro Nishiyama, Shigenori Tanaka, Jack Adam Tuszynski
{"title":"Non-Equilibrium Quantum Brain Dynamics: Water Coupled with Phonons and Photons.","authors":"Akihiro Nishiyama, Shigenori Tanaka, Jack Adam Tuszynski","doi":"10.3390/e26110981","DOIUrl":"10.3390/e26110981","url":null,"abstract":"<p><p>We investigate Quantum Electrodynamics (QED) of water coupled with sound and light, namely Quantum Brain Dynamics (QBD) of water, phonons and photons. We provide phonon degrees of freedom as additional quanta in the framework of QBD in this paper. We begin with the Lagrangian density QED with non-relativistic charged bosons, photons and phonons, and derive time-evolution equations of coherent fields and Kadanoff-Baym (KB) equations for incoherent particles. We next show an acoustic super-radiance solution in our model. We also introduce a kinetic entropy current in KB equations in 1st order approximation in the gradient expansion and show the H-theorem for self-energy in Hartree-Fock approximation. We finally derive conserved number density of charged bosons and conserved energy density in spatially homogeneous system.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 11","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11592528/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142726849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}