{"title":"A method for continuous-range sequence analysis with Jensen-Shannon divergence","authors":"M. Ré, G. G. A. Varela","doi":"10.4279/PIP.130001","DOIUrl":null,"url":null,"abstract":"Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the continuous type. However, MI estimation between a discrete range data set and a continuous range data set has not received so much attention. We therefore present here a method for the estimation of MI for this case, based on the kernel density approximation. This calculation may be of interest in diverse contexts. Since MI is closely related to the Jensen Shannon divergence, the method developed here is of particular interest in the problems of sequence segmentation and set comparisons.","PeriodicalId":19791,"journal":{"name":"Papers in Physics","volume":null,"pages":null},"PeriodicalIF":1.2000,"publicationDate":"2021-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Papers in Physics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4279/PIP.130001","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Mutual Information (MI) is a useful Information Theory tool for the recognition of mutual dependence between data sets. Several methods have been developed fore estimation of MI when both data sets are of the discrete type or when both are of the continuous type. However, MI estimation between a discrete range data set and a continuous range data set has not received so much attention. We therefore present here a method for the estimation of MI for this case, based on the kernel density approximation. This calculation may be of interest in diverse contexts. Since MI is closely related to the Jensen Shannon divergence, the method developed here is of particular interest in the problems of sequence segmentation and set comparisons.
期刊介绍:
Papers in Physics publishes original research in all areas of physics and its interface with other subjects. The scope includes, but is not limited to, physics of particles and fields, condensed matter, relativity and gravitation, nuclear physics, physics of fluids, biophysics, econophysics, chemical physics, statistical mechanics, soft condensed matter, materials science, mathematical physics and general physics. Contributions in the areas of foundations of physics, history of physics and physics education are not considered for publication. Articles published in Papers in Physics contain substantial new results and ideas that advance the state of physics in a non-trivial way. Articles are strictly reviewed by specialists prior to publication. Papers in Physics highlights outstanding articles published in the journal through the Editors'' choice section. Papers in Physics offers two distinct editorial treatments to articles from which authors can choose. In Traditional Review, manuscripts are submitted to anonymous reviewers seeking constructive criticism and editors make a decision on whether publication is appropriate. In Open Review, manuscripts are sent to reviewers. If the paper is considered original and technically sound, the article, the reviewer''s comments and the author''s reply are published alongside the names of all involved. This way, Papers in Physics promotes the open discussion of controversies among specialists that are of help to the reader and to the transparency of the editorial process. Moreover, our reviewers receive their due recognition by publishing a recorded citable report. Papers in Physics publishes Commentaries from the reviewer(s) if major disagreements remain after exchange with the authors or if a different insight proposed is considered valuable for the readers.