{"title":"Periodograms and the Method of Averaged Periodograms [Lecture Notes]","authors":"Shlomo Engelberg","doi":"10.1109/MSP.2023.3285044","DOIUrl":"10.1109/MSP.2023.3285044","url":null,"abstract":"In this “Lecture Notes” column, we show that it is possible to use deterministic arguments to gain some intuition into why using periodograms without averaging does not work well and why they “fail” in the way they do. We then explain how the probabilistic case can be seen as an extension of the deterministic case. Next, we give a brief description of the method of averaged periodograms and explain how the deterministic perspective points to additional cases where the method of averaged periodograms should prove effective. Finally, we provide several numerical examples to demonstrate the theoretical material, and “A Probabilistic Argument” provides a fairly detailed probabilistic justification that is an extension of the deterministic one.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43136496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Deep Learning Meets Sparse Regularization: A signal processing perspective","authors":"Rahul Parhi;Robert D. Nowak","doi":"10.1109/MSP.2023.3286988","DOIUrl":"10.1109/MSP.2023.3286988","url":null,"abstract":"Deep learning (DL) has been wildly successful in practice, and most of the state-of-the-art machine learning methods are based on neural networks (NNs). Lacking, however, is a rigorous mathematical theory that adequately explains the amazing performance of deep NNs (DNNs). In this article, we present a relatively new mathematical framework that provides the beginning of a deeper understanding of DL. This framework precisely characterizes the functional properties of NNs that are trained to fit to data. The key mathematical tools that support this framework include transform-domain sparse regularization, the Radon transform of computed tomography, and approximation theory, which are all techniques deeply rooted in signal processing. This framework explains the effect of weight decay regularization in NN training, use of skip connections and low-rank weight matrices in network architectures, role of sparsity in NNs, and explains why NNs can perform well in high-dimensional problems.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43312556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"New Society officers elected [Society News]","authors":"","doi":"10.1109/MSP.2023.3294034","DOIUrl":"10.1109/MSP.2023.3294034","url":null,"abstract":"Provides society information that may include news, reviews or technical notes that should be of interest to practitioners and researchers.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/79/10243484/10243461.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45110887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflecting on the Successes of ICASSP 2023 [President’s Message]","authors":"Athina Petropulu","doi":"10.1109/MSP.2023.3302476","DOIUrl":"10.1109/MSP.2023.3302476","url":null,"abstract":"As we gear up for the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024, it is essential to take a moment to celebrate the achievements and highlights of ICASSP 2023, which took place on Rhodes Island, Greece, this past June. ICASSP 2023 was a momentous event as it marked the first postpandemic ICASSP, and the return to in-person meetings. With the theme “Signal Processing in the AI Era,” the conference underscored the strong connection between signal processing and machine learning, highlighting the pivotal role of signal processing in shaping the development of artificial intelligence (AI).","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/79/10243484/10243464.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"62544125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sundeep Prabhakar Chepuri;Nir Shlezinger;Fan Liu;George C. Alexandropoulos;Stefano Buzzi;Yonina C. Eldar
{"title":"Integrated Sensing and Communications With Reconfigurable Intelligent Surfaces: From signal modeling to processing","authors":"Sundeep Prabhakar Chepuri;Nir Shlezinger;Fan Liu;George C. Alexandropoulos;Stefano Buzzi;Yonina C. Eldar","doi":"10.1109/MSP.2023.3279986","DOIUrl":"10.1109/MSP.2023.3279986","url":null,"abstract":"Integrated sensing and communications (ISAC) are envisioned to be an integral part of future wireless networks, especially when operating at the millimeter-wave (mm-wave) and terahertz (THz) frequency bands. However, establishing wireless connections at these high frequencies is quite challenging, mainly due to the penetrating path loss that prevents reliable communication and sensing. Another emerging technology for next-generation wireless systems is reconfigurable intelligent surface (RIS), which refers to hardware-efficient planar structures capable of modifying harsh propagation environments. In this article, we provide a tutorial-style overview of the applications and benefits of RISs for sensing functionalities in general, and for ISAC systems in particular. We highlight the potential advantages when fusing these two emerging technologies, and identify for the first time that 1) joint sensing and communications (S&C) designs are most beneficial when the channels referring to these operations are coupled, and that 2) RISs offer the means for controlling this beneficial coupling. The usefulness of RIS-aided ISAC goes beyond the obvious individual gains of each of these technologies in both performance and power efficiency. We also discuss the main signal processing challenges and future research directions that arise from the fusion of these two emerging technologies.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42345917","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On the Concept of Frequency in Signal Processing: A Discussion [Perspectives]","authors":"Moisés Soto-Bajo;Andrés Fraguela Collar;Javier Herrera-Vega","doi":"10.1109/MSP.2023.3257505","DOIUrl":"10.1109/MSP.2023.3257505","url":null,"abstract":"Nikola Tesla said: “If you want to find the secrets of the universe, think in terms of energy, frequency and vibration.” Unfortunately, this is a hieroglyph, and we are still looking for its Rosetta Stone.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46121569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Discrete Cosine Transform and Its Impact on Visual Compression: Fifty Years From Its Invention [Perspectives]","authors":"Yao Wang;Debargha Mukherjee","doi":"10.1109/MSP.2023.3282775","DOIUrl":"10.1109/MSP.2023.3282775","url":null,"abstract":"Compression is essential for efficient storage and transmission of signals. One powerful method for compression is through the application of orthogonal transforms, which convert a group of \u0000<inline-formula><tex-math>${N}$</tex-math></inline-formula>\u0000 data samples into a group of \u0000<inline-formula><tex-math>${N}$</tex-math></inline-formula>\u0000 transform coefficients. In transform coding, the \u0000<inline-formula><tex-math>${N}$</tex-math></inline-formula>\u0000 samples are first transformed, and then the coefficients are individually quantized and entropy coded into binary bits. The transform serves two purposes: one is to compact the energy of the original \u0000<inline-formula><tex-math>${N}$</tex-math></inline-formula>\u0000 samples into coefficients with increasingly smaller variances so that removing smaller coefficients have negligible reconstruction errors, and another is to decorrelate the original samples so that the coefficients can be quantized and entropy coded individually without losing compression performance. The Karhunen–Loève transform (KLT) is an optimal transform for a source signal with a stationary covariance matrix in the sense that it completely decorrelates the original samples, and that it maximizes energy compaction (i.e., it requires the fewest number of coefficients to reach a target reconstruction error). However, the KLT is signal dependent and cannot be computed with a fast algorithm.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":14.9,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"62544038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}