arXiv - MATH - Information Theory最新文献_第10页

Bi-Level Spatial and Channel-aware Transformer for Learned Image Compression 用于学习型图像压缩的双级空间和信道感知变换器

arXiv - MATH - Information Theory Pub Date : 2024-08-07 DOI: arxiv-2408.03842

Hamidreza Soltani, Erfan Ghasemi

{"title":"Bi-Level Spatial and Channel-aware Transformer for Learned Image Compression","authors":"Hamidreza Soltani, Erfan Ghasemi","doi":"arxiv-2408.03842","DOIUrl":"https://doi.org/arxiv-2408.03842","url":null,"abstract":"Recent advancements in learned image compression (LIC) methods have\u0000demonstrated superior performance over traditional hand-crafted codecs. These\u0000learning-based methods often employ convolutional neural networks (CNNs) or\u0000Transformer-based architectures. However, these nonlinear approaches frequently\u0000overlook the frequency characteristics of images, which limits their\u0000compression efficiency. To address this issue, we propose a novel\u0000Transformer-based image compression method that enhances the transformation\u0000stage by considering frequency components within the feature map. Our method\u0000integrates a novel Hybrid Spatial-Channel Attention Transformer Block (HSCATB),\u0000where a spatial-based branch independently handles high and low frequencies at\u0000the attention layer, and a Channel-aware Self-Attention (CaSA) module captures\u0000information across channels, significantly improving compression performance.\u0000Additionally, we introduce a Mixed Local-Global Feed Forward Network (MLGFFN)\u0000within the Transformer block to enhance the extraction of diverse and rich\u0000information, which is crucial for effective compression. These innovations\u0000collectively improve the transformation's ability to project data into a more\u0000decorrelated latent space, thereby boosting overall compression efficiency.\u0000Experimental results demonstrate that our framework surpasses state-of-the-art\u0000LIC methods in rate-distortion performance.","PeriodicalId":501082,"journal":{"name":"arXiv - MATH - Information Theory","volume":"8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141943496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Binary Triorthogonal and CSS-T Codes for Quantum Error Correction 用于量子纠错的二进制三正交和 CSS-T 编码

arXiv - MATH - Information Theory Pub Date : 2024-08-06 DOI: arxiv-2408.02916

Eduardo Camps-Moreno, Hiram H. López, Gretchen L. Matthews, Diego Ruano, Rodrigo San-José, Ivan Soprunov

引用次数: 0

Rate-Splitting for Joint Unicast and Multicast Transmission in LEO Satellite Networks with Non-Uniform Traffic Demand 具有非均匀流量需求的低地轨道卫星网络中单播和多播联合传输的速率分配

arXiv - MATH - Information Theory Pub Date : 2024-08-06 DOI: arxiv-2408.02872

Jaehyup Seong, Juha Park, Dong-Hyun Jung, Jeonghun Park, Wonjae Shin

{"title":"Rate-Splitting for Joint Unicast and Multicast Transmission in LEO Satellite Networks with Non-Uniform Traffic Demand","authors":"Jaehyup Seong, Juha Park, Dong-Hyun Jung, Jeonghun Park, Wonjae Shin","doi":"arxiv-2408.02872","DOIUrl":"https://doi.org/arxiv-2408.02872","url":null,"abstract":"Low Earth orbit (LEO) satellite communications (SATCOM) with ubiquitous\u0000global connectivity is deemed a pivotal catalyst in advancing wireless\u0000communication systems for 5G and beyond. LEO SATCOM excels in delivering\u0000versatile information services across expansive areas, facilitating both\u0000unicast and multicast transmissions via high-speed broadband capability.\u0000Nonetheless, given the broadband coverage of LEO SATCOM, traffic demand\u0000distribution within the service area is non-uniform, and the\u0000time/frequency/power resources available at LEO satellites remain significantly\u0000limited. Motivated by these challenges, we propose a rate-matching framework\u0000for non-orthogonal unicast and multicast (NOUM) transmission. Our approach aims\u0000to minimize the difference between offered rates and traffic demands for both\u0000unicast and multicast messages. By multiplexing unicast and multicast\u0000transmissions over the same radio resource, rate-splitting multiple access\u0000(RSMA) is employed to manage interference between unicast and multicast\u0000streams, as well as inter-user interference under imperfect channel state\u0000information at the LEO satellite. To address the formulated problems\u0000non-smoothness and non-convexity, the common rate is approximated using the\u0000LogSumExp technique. Thereafter, we represent the common rate portion as the\u0000ratio of the approximated function, converting the problem into an\u0000unconstrained form. A generalized power iteration (GPI)-based algorithm, coined\u0000GPI-RS-NOUM, is proposed upon this reformulation. Through comprehensive\u0000numerical analysis across diverse simulation setups, we demonstrate that the\u0000proposed framework outperforms various benchmarks for LEO SATCOM with uneven\u0000traffic demands.","PeriodicalId":501082,"journal":{"name":"arXiv - MATH - Information Theory","volume":"19 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141943498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Codes Correcting Two Bursts of Exactly $b$ Deletions 纠正两个恰好删除 b$ 的脉冲串的编码

arXiv - MATH - Information Theory Pub Date : 2024-08-06 DOI: arxiv-2408.03113

Zuo Ye, Wenjun Yu, Ohad Elishco

引用次数: 0

Causal Vector-valued Witsenhausen Counterexamples with Feedback 带反馈的因果向量维森豪森反例

arXiv - MATH - Information Theory Pub Date : 2024-08-06 DOI: arxiv-2408.03037

Mengyuan Zhao, Maël Le Treust, Tobias J. Oechtering

引用次数: 0

MacWilliams Identities for Rank metric codes over Galois rings 伽罗瓦环上兰克度量编码的麦克威廉斯等式

arXiv - MATH - Information Theory Pub Date : 2024-08-06 DOI: arxiv-2408.03237

Iván Blanco-Chacón, Alberto F. Boix, Marcus Grefferath, Erik Hieta-aho

引用次数: 0

Second 6G life Workshop on Post Shannon Theory 第二届 6G 后香农理论生活研讨会

arXiv - MATH - Information Theory Pub Date : 2024-08-05 DOI: arxiv-2408.02446

Yaning Zhao, Christian Deppe

{"title":"Second 6G life Workshop on Post Shannon Theory","authors":"Yaning Zhao, Christian Deppe","doi":"arxiv-2408.02446","DOIUrl":"https://doi.org/arxiv-2408.02446","url":null,"abstract":"The one-day workshop, held prior to the \"ZIF Workshop on Information Theory\u0000and Related Fields\", provided an excellent opportunity for in-depth discussions\u0000on several topics within the field of post-Shannon theory. The agenda covered\u0000deterministic and randomized identification, focusing on various methods and\u0000algorithms for identifying data or signals deterministically and through\u0000randomized processes. It explored the theoretical foundations and practical\u0000applications of these techniques. The session on resources for increasing\u0000identification capacity examined the different resources and strategies that\u0000can be utilized to boost the capacity for identifying information. This\u0000included discussions on both hardware and software solutions, as well as\u0000innovative approaches to resource allocation and optimization. Participants\u0000delved into common randomness generation, essential for various cryptographic\u0000protocols and communication systems. The session highlighted recent\u0000advancements and practical implementations of common randomness in secure\u0000communications. The workshop concluded with a detailed look at the development\u0000and practical deployment of identification codes. Experts shared insights on\u0000code construction techniques, implementation challenges, and real-world\u0000applications in various communication systems. We extend our thanks to the\u0000esteemed speakers for their valuable contributions: Caspar von Lengerke, Wafa\u0000Labidi, Ilya Vorobyev, Johannes Rosenberger, Jonathan Huffmann, and Pau\u0000Colomer. Their presentations and insights significantly enriched the workshop.\u0000Additionally, we are grateful to all the participants whose active engagement,\u0000constructive comments, and stimulating discussions made the event a success.\u0000Your involvement was crucial in fostering a collaborative and intellectually\u0000vibrant environment.","PeriodicalId":501082,"journal":{"name":"arXiv - MATH - Information Theory","volume":"2 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141943502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

On the Complexity of the Conditional Independence Implication Problem With Bounded Cardinalities 论有界标的条件独立隐含问题的复杂性

arXiv - MATH - Information Theory Pub Date : 2024-08-05 DOI: arxiv-2408.02550

Michał Makowski

引用次数: 0

Higher weight spectra and Betti numbers of Reed-Muller codes $RM_2(2,2)$ 里德-穆勒编码 $RM_2(2,2)$ 的高权重谱和贝蒂数

arXiv - MATH - Information Theory Pub Date : 2024-08-05 DOI: arxiv-2408.02548

Sudhir R. Ghorpade, Trygve Johnsen, Rati Ludhani, Rakhi Pratihar

引用次数: 0

On Galois duality, self-orthogonality, and dual-containment of matrix product codes 论矩阵积码的伽罗瓦对偶性、自正交性和对偶包含性

arXiv - MATH - Information Theory Pub Date : 2024-08-05 DOI: arxiv-2408.02799

Ramy Farouk Taki Eldin

{"title":"On Galois duality, self-orthogonality, and dual-containment of matrix product codes","authors":"Ramy Farouk Taki Eldin","doi":"arxiv-2408.02799","DOIUrl":"https://doi.org/arxiv-2408.02799","url":null,"abstract":"In recent literature, matrix product (MP) codes and their duals have gained\u0000significant attention due to their application in the construction of quantum\u0000stabilizer codes. In this paper, we begin with providing a formula that\u0000characterizes the Galois dual of MP codes. Using this formula, we establish the\u0000conditions under which MP codes are self-orthogonal and dual-containing.\u0000Although similar results may exist in the literature, the novelty and\u0000superiority of our results can be identified in the following points. Previous\u0000results that characterize the duals of MP codes only apply to MP codes with an\u0000invertible square defining matrix $mathcal{A}$. However, our characterization\u0000applies to MP code with any defining matrix, whether $mathcal{A}$ is not\u0000square or not of full row rank. Previous studies on the conditions for\u0000self-orthogonality or dual-containment of MP codes have assumed certain\u0000structures for the product $mathcal{A}mathcal{A}^T$ or\u0000$mathcal{A}mathcal{A}^{dagger}$, such as being diagonal, anti-diagonal,\u0000monomial, or partitioned Hermitian orthogonal. However, our conditions do not\u0000necessitate such specific structures. Previous studies investigated MP code\u0000duality in the context of Euclidean and Hermitian duals; however, we\u0000investigate MP code duality in the broader context of Galois dual, with\u0000Euclidean and Hermitian duals acting as special cases. Finally, it is worth\u0000noting that the proposed conditions for Galois self-orthogonality or\u0000dual-containment are both necessary and sufficient. To demonstrate the\u0000theoretical results, several numerical examples with best-known parameters MP\u0000codes are provided.","PeriodicalId":501082,"journal":{"name":"arXiv - MATH - Information Theory","volume":"62 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141943499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0