{"title":"基于完全提升随机对偶理论的二元感知器容量","authors":"Mihailo Stojnic","doi":"arxiv-2312.00073","DOIUrl":null,"url":null,"abstract":"We study the statistical capacity of the classical binary perceptrons with\ngeneral thresholds $\\kappa$. After recognizing the connection between the\ncapacity and the bilinearly indexed (bli) random processes, we utilize a recent\nprogress in studying such processes to characterize the capacity. In\nparticular, we rely on \\emph{fully lifted} random duality theory (fl RDT)\nestablished in \\cite{Stojnicflrdt23} to create a general framework for studying\nthe perceptrons' capacities. Successful underlying numerical evaluations are\nrequired for the framework (and ultimately the entire fl RDT machinery) to\nbecome fully practically operational. We present results obtained in that\ndirections and uncover that the capacity characterizations are achieved on the\nsecond (first non-trivial) level of \\emph{stationarized} full lifting. The\nobtained results \\emph{exactly} match the replica symmetry breaking predictions\nobtained through statistical physics replica methods in \\cite{KraMez89}. Most\nnotably, for the famous zero-threshold scenario, $\\kappa=0$, we uncover the\nwell known $\\alpha\\approx0.8330786$ scaled capacity.","PeriodicalId":501330,"journal":{"name":"arXiv - MATH - Statistics Theory","volume":"83 3","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Binary perceptrons capacity via fully lifted random duality theory\",\"authors\":\"Mihailo Stojnic\",\"doi\":\"arxiv-2312.00073\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We study the statistical capacity of the classical binary perceptrons with\\ngeneral thresholds $\\\\kappa$. After recognizing the connection between the\\ncapacity and the bilinearly indexed (bli) random processes, we utilize a recent\\nprogress in studying such processes to characterize the capacity. In\\nparticular, we rely on \\\\emph{fully lifted} random duality theory (fl RDT)\\nestablished in \\\\cite{Stojnicflrdt23} to create a general framework for studying\\nthe perceptrons' capacities. Successful underlying numerical evaluations are\\nrequired for the framework (and ultimately the entire fl RDT machinery) to\\nbecome fully practically operational. We present results obtained in that\\ndirections and uncover that the capacity characterizations are achieved on the\\nsecond (first non-trivial) level of \\\\emph{stationarized} full lifting. The\\nobtained results \\\\emph{exactly} match the replica symmetry breaking predictions\\nobtained through statistical physics replica methods in \\\\cite{KraMez89}. Most\\nnotably, for the famous zero-threshold scenario, $\\\\kappa=0$, we uncover the\\nwell known $\\\\alpha\\\\approx0.8330786$ scaled capacity.\",\"PeriodicalId\":501330,\"journal\":{\"name\":\"arXiv - MATH - Statistics Theory\",\"volume\":\"83 3\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-11-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - MATH - Statistics Theory\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2312.00073\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - MATH - Statistics Theory","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2312.00073","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Binary perceptrons capacity via fully lifted random duality theory
We study the statistical capacity of the classical binary perceptrons with
general thresholds $\kappa$. After recognizing the connection between the
capacity and the bilinearly indexed (bli) random processes, we utilize a recent
progress in studying such processes to characterize the capacity. In
particular, we rely on \emph{fully lifted} random duality theory (fl RDT)
established in \cite{Stojnicflrdt23} to create a general framework for studying
the perceptrons' capacities. Successful underlying numerical evaluations are
required for the framework (and ultimately the entire fl RDT machinery) to
become fully practically operational. We present results obtained in that
directions and uncover that the capacity characterizations are achieved on the
second (first non-trivial) level of \emph{stationarized} full lifting. The
obtained results \emph{exactly} match the replica symmetry breaking predictions
obtained through statistical physics replica methods in \cite{KraMez89}. Most
notably, for the famous zero-threshold scenario, $\kappa=0$, we uncover the
well known $\alpha\approx0.8330786$ scaled capacity.