{"title":"IEEE Transactions on Information Theory Publication Information","authors":"","doi":"10.1109/TIT.2025.3539816","DOIUrl":"https://doi.org/10.1109/TIT.2025.3539816","url":null,"abstract":"","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 3","pages":"C2-C2"},"PeriodicalIF":2.2,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10896911","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143465591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xingyu Zheng;Cuiling Fan;Zhengchun Zhou;Sihem Mesnager;Yang Yang
{"title":"Wide-Gap Frequency Hopping Sequences With No-Hit-Zone: Bounds and Their Optimal Constructions","authors":"Xingyu Zheng;Cuiling Fan;Zhengchun Zhou;Sihem Mesnager;Yang Yang","doi":"10.1109/TIT.2025.3544225","DOIUrl":"https://doi.org/10.1109/TIT.2025.3544225","url":null,"abstract":"Frequency hopping sequences (FHSs) play a crucial role in frequency hopping (FH) communication systems due to their strong anti-interference ability, low interception probability, high confidentiality and strong concealment. The objective of this paper is to construct FHSs for quasi-synchronous frequency-hopping multiple access (FHMA) communication systems that simultaneously achieve optimal no-hit zone (NHZ) length and optimal gap. To accomplish this, the paper first derives tighter upper bounds for the gap size in both periodic and aperiodic scenarios under the assumption that all frequencies within the designated frequency slot set are fully utilized. Subsequently, this paper proposes a class of wide-gap frequency hopping sequences (WGFHSs) and a class of multi-timeslot wide-gap frequency hopping sequences (MTWGFHSs), both of which simultaneously exhibit optimal NHZ length and optimal gap.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 5","pages":"3989-3998"},"PeriodicalIF":2.2,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143870963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Private Inference in Quantized Models","authors":"Zirui Deng;Vinayak Ramkumar;Rawad Bitar;Netanel Raviv","doi":"10.1109/TIT.2025.3543908","DOIUrl":"https://doi.org/10.1109/TIT.2025.3543908","url":null,"abstract":"A typical setup in many machine learning scenarios involves a server that holds a model and a user that possesses data, and the challenge is to perform inference while safeguarding the privacy of both parties. <italic>Private Inference</i> has been extensively explored in recent years, mainly from a cryptographic standpoint via techniques like homomorphic encryption and multiparty computation. These approaches often come with high computational overhead and may degrade the accuracy of the model. In our work, we take a different approach inspired by the <italic>Private Information Retrieval</i> literature. We view private inference as the task of retrieving inner products of parameter vectors with the data, a fundamental operation in many machine learning models. We introduce schemes that enable such retrieval of inner products for models with <italic>quantized</i> (i.e., restricted to a finite set) weights; such models are extensively used in practice due to a wide range of benefits. In addition, our schemes uncover a fundamental tradeoff between user and server privacy. Our information-theoretic approach is applicable to a wide range of problems and robust in privacy guarantees for both the user and the server.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 5","pages":"3957-3973"},"PeriodicalIF":2.2,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143870976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"IEEE Transactions on Information Theory Information for Authors","authors":"","doi":"10.1109/TIT.2025.3539818","DOIUrl":"https://doi.org/10.1109/TIT.2025.3539818","url":null,"abstract":"","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 3","pages":"C3-C3"},"PeriodicalIF":2.2,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10896626","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143455193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chao Chen;Yunghsiang S. Han;Nianqi Tang;Xiao Ma;Baoming Bai
{"title":"Parallel Welch–Berlekamp Algorithm","authors":"Chao Chen;Yunghsiang S. Han;Nianqi Tang;Xiao Ma;Baoming Bai","doi":"10.1109/TIT.2025.3542812","DOIUrl":"https://doi.org/10.1109/TIT.2025.3542812","url":null,"abstract":"This paper presents new variants of the Welch-Berlekamp algorithm that are favorable to hardware implementation. First, we derive the parallel Welch-Berlekamp (PWB) algorithm in a constructive manner based on the properties of solutions to the rational interpolation problem. The algorithm features the simultaneously performed discrepancy computation and polynomial update. Second, we explore the early-termination mechanism of the PWB algorithm for decoding of Reed-Solomon (RS) codes. By introducing the concept of incomplete error locator polynomial, we show that if <inline-formula> <tex-math>$e leq t$ </tex-math></inline-formula> (where <italic>e</i> is the number of errors and <italic>t</i> is the error correction capability), the PWB algorithm can be terminated at latest at the completion of the <inline-formula> <tex-math>$(t+ e)$ </tex-math></inline-formula>-th iteration. This leads to the early-terminating PWB (EPWB) algorithm. Finally, we develop frequency-domain versions of the PWB and EPWB algorithms, namely, FPWB and FEPWB. The key point toward the two algorithms is to replace the update of polynomial coefficients with the update of polynomial evaluations. It is worth noting that the FEPWB algorithm applies only to shortened RS codes. Furthermore, an efficient systolic architecture for the FPWB algorithm is designed, which is easily adapted for the FEPWB algorithm.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 5","pages":"3473-3488"},"PeriodicalIF":2.2,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143875248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Asymptotic Capacity of 1-bit MIMO Fading Channels","authors":"Sheng Yang;Richard Combes","doi":"10.1109/TIT.2025.3543724","DOIUrl":"https://doi.org/10.1109/TIT.2025.3543724","url":null,"abstract":"In this work, we investigate the capacity of multi-antenna fading channels with 1-bit quantized output per receive antenna. Specifically, leveraging Bayesian statistical tools, we analyze the asymptotic regime with a large number of receive antennas. In the coherent case, where the channel state information (CSI) is known at the receiver’s side, we characterize the asymptotic capacity and derive the exact scaling in the extreme regimes of signal-to-noise ratio (SNR) and the number of transmit antennas. In the non-coherent case, where the CSI is unknown but remains constant during <italic>T</i> symbol periods, we first obtain the exact asymptotic capacity for <inline-formula> <tex-math>$Tle 3$ </tex-math></inline-formula>. Then, we propose a scheme involving uniform signaling in the covariance space and derive a non-asymptotic lower bound on the capacity for an arbitrary block size <italic>T</i>. Furthermore, we propose a genie-aided upper bound where the channel is revealed to the receiver. We show that the upper and lower bounds coincide when <italic>T</i> is large. In the low SNR regime, we derive the asymptotic capacity up to a vanishing term, which, remarkably, matches our capacity lower bound.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 4","pages":"2626-2641"},"PeriodicalIF":2.2,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143675965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Constructions of Optimal Cyclic Codes With h-Level Hierarchical Locality","authors":"Xing Liu","doi":"10.1109/TIT.2025.3542905","DOIUrl":"https://doi.org/10.1109/TIT.2025.3542905","url":null,"abstract":"In order to correct different numbers of erasures in distributed storage systems, the design of locally repairable codes with hierarchical locality (H-LRCs) is crucial. In this paper, we study <italic>h</i>-level H-LRCs where <italic>h</i> is not limited to 2. We present six classes of cyclic <italic>h</i>-level H-LRCs which are optimal with respect to the generalized Singleton-like bound. The first five classes of cyclic <italic>h</i>-level H-LRCs have length <inline-formula> <tex-math>$ln_{1}$ </tex-math></inline-formula> such that <inline-formula> <tex-math>$gcd (l,q)=1$ </tex-math></inline-formula>, and <inline-formula> <tex-math>$n_{1}|(q-1)$ </tex-math></inline-formula> or <inline-formula> <tex-math>$n_{1}|(q+1)$ </tex-math></inline-formula>. The last class of cyclic <italic>h</i>-level H-LRCs has length <inline-formula> <tex-math>$n|(q+1)$ </tex-math></inline-formula>. The minimum Hamming distances of them are <inline-formula> <tex-math>$d=delta _{1}+i$ </tex-math></inline-formula> where <italic>i</i> can take 0, 2, <inline-formula> <tex-math>$delta _{h}$ </tex-math></inline-formula>, and so on. Furthermore, these six classes of cyclic <italic>h</i>-level H-LRCs have new parameters which are not covered in the literature.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 6","pages":"4193-4205"},"PeriodicalIF":2.2,"publicationDate":"2025-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144117254","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On the Amount of Randomness Needed for Improving Distributed Wireless Link Scheduling Under Arbitrary Interference","authors":"Dariusz R. Kowalski;Miguel A. Mosteiro","doi":"10.1109/TIT.2025.3542767","DOIUrl":"https://doi.org/10.1109/TIT.2025.3542767","url":null,"abstract":"We study the Distributed Wireless Link Scheduling (DWLS) problem: there is a set of <italic>n</i> autonomous stations, called senders, each with a message to be delivered to some other station, called receiver. The names and locations of all stations are arbitrarily selected and unknown to each other, to mirror an arbitrary scenario that may occur in mobile communication. Each pair ((sender,receiver),message) is called a request, and the event of successfully delivering the message is called the realization of the request. In the DWLS problem, the requests are realized through wireless communication links (which is a conceptual notion of two nodes being capable of direct wireless delivery of a message) between the stations. The decision to transmit a message is made locally by each station. We consider networks where communication links may interfere with each other, where the interference is an arbitrary input function of each pair of links, customarily called affectance; if the total affectance of other links whose senders are currently transmitting is above a given threshold, the considered transmission is not successful. In the above context, we study the impact of the number of truly random bits used by each link/sender, on the length of the transmission schedules. Specifically, for any set <italic>L</i> of <italic>n</i> requests with maximum average affectance <inline-formula> <tex-math>$A(L)$ </tex-math></inline-formula>, we present a deterministic algorithm (i.e., 0 random bits) and a randomized algorithm using <inline-formula> <tex-math>$O(log A(L)log n)$ </tex-math></inline-formula> random bits per link. (In this abstract we present formulas in simplified forms, for brevity.) The lengths of their transmission schedules are <inline-formula> <tex-math>$O(A(L)^{2}log ^{3} n)$ </tex-math></inline-formula> and <inline-formula> <tex-math>$O(A(L)log n)$ </tex-math></inline-formula>, respectively. We then combine both approaches to get a randomized solution using <inline-formula> <tex-math>$O(log W log n)$ </tex-math></inline-formula> truly random bits per station with schedules of length <inline-formula> <tex-math>$Oleft ({{frac {A(L)^{2}}{W}log n}}right)$ </tex-math></inline-formula>, for any <inline-formula> <tex-math>$Wle A(L)$ </tex-math></inline-formula>. To the best of our knowledge, our study is a first step towards understanding the trade-offs between randomness and time complexity of Link Scheduling under arbitrary interference. It is particularly important as currently used (in practice) wireless protocols are either deterministic or use a very small random seed of (truly) random bits.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 4","pages":"3157-3166"},"PeriodicalIF":2.2,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143667311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christoph Hofmeister;Luis Maßny;Eitan Yaakobi;Rawad Bitar
{"title":"Byzantine-Resilient Gradient Coding Through Local Gradient Computations","authors":"Christoph Hofmeister;Luis Maßny;Eitan Yaakobi;Rawad Bitar","doi":"10.1109/TIT.2025.3542896","DOIUrl":"https://doi.org/10.1109/TIT.2025.3542896","url":null,"abstract":"We consider gradient coding in the presence of an adversary controlling so-called malicious workers trying to corrupt the computations. Previous works propose the use of MDS codes to treat the responses from malicious workers as errors and correct them using the error-correction properties of the code. This comes at the expense of increasing the replication, i.e., the number of workers <italic>each partial gradient</i> is computed by. In this work, we propose a way to reduce the replication to <inline-formula> <tex-math>$ {s} +1$ </tex-math></inline-formula> instead of <inline-formula> <tex-math>$2 {s} +1$ </tex-math></inline-formula> in the presence of <italic>s</i> malicious workers. Our method detects erroneous inputs from the malicious workers, transforming them into erasures. This comes at the expense of <italic>s</i> additional local computations at the main node and additional rounds of light communication between the main node and the workers. We define a general framework and give fundamental limits for fractional repetition data allocations. Our scheme is optimal in terms of replication and local computation and incurs a communication cost that is asymptotically, in the size of the dataset, a multiplicative factor away from the derived bound. We furthermore show how additional redundancy can be exploited to reduce the number of local computations and communication cost, or, alternatively, tolerate straggling workers.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 4","pages":"3142-3156"},"PeriodicalIF":2.2,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10891921","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143667312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Quantum Ruzsa Divergence to Quantify Magic","authors":"Kaifeng Bu;Weichen Gu;Arthur Jaffe","doi":"10.1109/TIT.2025.3543276","DOIUrl":"https://doi.org/10.1109/TIT.2025.3543276","url":null,"abstract":"In this work, we investigate the behavior of quantum entropy under quantum convolution and its application in quantifying magic. We first establish an entropic, quantum central limit theorem (q-CLT), where the rate of convergence is bounded by the magic gap. We also introduce a new quantum divergence based on quantum convolution, called the quantum Ruzsa divergence, to study the stabilizer structure of quantum states. We conjecture a “convolutional strong subadditivity” inequality, which leads to the triangle inequality for the quantum Ruzsa divergence. In addition, we propose two new magic measures, the quantum Ruzsa divergence of magic and quantum-doubling constant, to quantify the amount of magic in quantum states. Finally, by using the quantum convolution, we extend the classical, inverse sumset theory to the quantum case. These results shed new insight into the study of the stabilizer and magic states in quantum information theory.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 4","pages":"2726-2740"},"PeriodicalIF":2.2,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143676131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}