SIAM Review最新文献

{"title":"When Data Driven Reduced Order Modeling Meets Full Waveform Inversion","authors":"Liliana Borcea, Josselin Garnier, Alexander V. Mamonov, Jörn Zimmerling","doi":"10.1137/23m1552826","DOIUrl":"https://doi.org/10.1137/23m1552826","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 501-532, May 2024. <br/> Waveform inversion is concerned with estimating a heterogeneous medium, modeled by variable coefficients of wave equations, using sources that emit probing signals and receivers that record the generated waves. It is an old and intensively studied inverse problem with a wide range of applications, but the existing inversion methodologies are still far from satisfactory. The typical mathematical formulation is a nonlinear least squares data fit optimization and the difficulty stems from the nonconvexity of the objective function that displays numerous local minima at which local optimization approaches stagnate. This pathological behavior has at least three unavoidable causes: (1) The mapping from the unknown coefficients to the wave field is nonlinear and complicated. (2) The sources and receivers typically lie on a single side of the medium, so only backscattered waves are measured. (3) The probing signals are band limited and with high frequency content. There is a lot of activity in the computational science and engineering communities that seeks to mitigate the difficulty of estimating the medium by data fitting. In this paper we present a different point of view, based on reduced order models (ROMs) of two operators that control the wave propagation. The ROMs are called data driven because they are computed directly from the measurements, without any knowledge of the wave field inside the inaccessible medium. This computation is noniterative and uses standard numerical linear algebra methods. The resulting ROMs capture features of the physics of wave propagation in a complementary way and have surprisingly good approximation properties that facilitate waveform inversion.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"24 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141904641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Research Spotlights","authors":"Stefan M. Wild","doi":"10.1137/24n975931","DOIUrl":"https://doi.org/10.1137/24n975931","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 479-479, May 2024. &lt;br/&gt; Equitable distribution of geographically dispersed resources presents a significant challenge, particularly in defining quantifiable measures of equity. How can we optimally allocate polling sites or hospitals to serve their constituencies? This issue's first Research Spotlight, “Persistent Homology for Resource Coverage: A Case Study of Access to Polling Sites,\" addresses these questions by demonstrating the application of topological data analysis to identify holes in resource accessibility and coverage. Authors Abigail Hickok, Benjamin Jarman, Michael Johnson, Jiajie Luo, and Mason A. Porter employ persistent homology, a technique that tracks the formation and disappearance of these holes as spatial scales vary. To make matters concrete, the authors consider a case study on access to polling sites and use a non-Euclidean distance that accounts for both travel and waiting times. In their case study, the authors use a weighted Vietoris--Rips filtration based on a symmetrized form of this distance and limit their examination to instances where the approximations underlying the filtration are less likely to lead to approximation-based artifacts. Details, as well as source code, are provided on the estimation of the various quantities, such as travel time, waiting time, and demographics (e.g., age, vehicle access). The result is a homology class that “dies\" at time $t$ if it takes $t$ total minutes to cast a vote. The paper concludes with an exposition of potential limitations and future directions that serve to encourage additional investigation into this class of problems (which includes settings where one wants to deploy different sensors to cover a spatial domain) and related techniques. What secrets lurk within? From flaws in human-made infrastructure to materials deep beneath the Earth's land and ocean surfaces to anomalies in patients, our next Research Spotlight, “When Data Driven Reduced Order Modeling Meets Full Waveform Inversion,\" addresses math and methods to recover the unknown. Authors Liliana Borcea, Josselin Garnier, Alexander V. Mamonov, and Jörn Zimmerling show how tools from numerical linear algebra and reduced-order modeling can be brought to bear on inverse wave scattering problems. Their setup encapsulates a wide variety of sensing modalities, wherein receivers emit a signal (such as an acoustic wave) and a time series of wavefield measurements is subsequently captured at one or more sources. Full waveform inversion refers to the recovery of the unknown “within\" and is typically addressed via iterative, nonlinear equations/least-squares solvers. However, it is often plagued by a notoriously nonconvex, ill-conditioned optimization landscape. The authors show how some of the challenges typically encountered in this inversion can be mitigated with the use of reduced-order models. These models employ observed data snapshots to form lower-dimensional, computationally a","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"76 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141908890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Education","authors":"Hélène Frankowska","doi":"10.1137/24n975955","DOIUrl":"https://doi.org/10.1137/24n975955","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 573-573, May 2024. <br/> In this issue the Education section presents “Combinatorial and Hodge Laplacians: Similarities and Differences,” by Emily Ribando-Gros, Rui Wang, Jiahui Chen, Yiying Tong, and Guo-Wei Wei. Combinatorial Laplacians and their spectra are important tools in the study of molecular stability, electrical networks, neuroscience, deep learning, signal processing, etc. The continuous Hodge Laplacian allows one, in some cases, to generate an unknown shape from only its Laplacian spectrum. In particular, both combinatorial Laplacians and continuous Hodge Laplacian are useful in describing the topology of data; see, for instance, [L.-H. Lim, “Hodge Laplacians on graphs,” SIAM Rev., 62 (2020), pp. 685--715]. Since nowadays computations frequently involve these Laplacians, it is important to have a good understanding of the differences and relations between them. Indeed, though the Hodge Laplacian and the combinatorial Laplacian share similarities in revealing the topological dimension and geometric shape of data, at the same time they are intrinsically different in their domains of definitions and applicability to specific data formats. To facilitate comparisons, the authors introduce boundary-induced graph (BIG) Laplacians, the purpose of which is “to put the combinatorial Laplacians and Hodge Laplacian on equal footing.” BIG Laplacian brings, in fact, the combinatorial Laplacian closer to the continuous Hodge Laplacian. In this paper similarities and differences between combinatorial Laplacian, BIG Laplacian, and Hodge Laplacian are examined. Some elements of spectral analysis related to topological data analysis (TDA) are also provided. TDA and connected ideas have recently gained a lot of interest, and so this paper is timely. It is written in a way that should make it accessible for early career researchers; the reader should already have a good understanding of some notions of graph theory, spectral geometry, differential geometry, and algebraic topology. The paper is not self-contained and eventually could be used by group-based research projects in a Master's program for advanced mathematics students.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"38 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141909212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Persistent Homology for Resource Coverage: A Case Study of Access to Polling Sites","authors":"Abigail Hickok, Benjamin Jarman, Michael Johnson, Jiajie Luo, Mason A. Porter","doi":"10.1137/22m150410x","DOIUrl":"https://doi.org/10.1137/22m150410x","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 481-500, May 2024. <br/> It is important to choose the geographical distributions of public resources in a fair and equitable manner. However, it is complicated to quantify the equity of such a distribution; important factors include distances to resource sites, availability of transportation, and ease of travel. We use persistent homology, which is a tool from topological data analysis, to study the availability and coverage of polling sites. The information from persistent homology allows us to infer holes in a distribution of polling sites. We analyze and compare the coverage of polling sites in Los Angeles County and five cities (Atlanta, Chicago, Jacksonville, New York City, and Salt Lake City), and we conclude that computation of persistent homology appears to be a reasonable approach to analyzing resource coverage.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"1 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141909213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Operator Learning Using Random Features: A Tool for Scientific Computing","authors":"Nicholas H. Nelsen, Andrew M. Stuart","doi":"10.1137/24m1648703","DOIUrl":"https://doi.org/10.1137/24m1648703","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 535-571, May 2024. <br/> Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing, which may often be framed in terms of operators mapping between spaces of functions. Building on the classical random features methodology for scalar regression, this paper introduces the function-valued random features method. This leads to a supervised operator learning architecture that is practical for nonlinear problems yet is structured enough to facilitate efficient training through the optimization of a convex, quadratic cost. Due to the quadratic structure, the trained model is equipped with convergence guarantees and error and complexity bounds, properties that are not readily available for most other operator learning architectures. At its core, the proposed approach builds a linear combination of random operators. This turns out to be a low-rank approximation of an operator-valued kernel ridge regression algorithm, and hence the method also has strong connections to Gaussian process regression. The paper designs function-valued random features that are tailored to the structure of two nonlinear operator learning benchmark problems arising from parametric partial differential equations. Numerical results demonstrate the scalability, discretization invariance, and transferability of the function-valued random features method.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"68 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141909214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Combinatorial and Hodge Laplacians: Similarities and Differences","authors":"Emily Ribando-Gros, Rui Wang, Jiahui Chen, Yiying Tong, Guo-Wei Wei","doi":"10.1137/22m1482299","DOIUrl":"https://doi.org/10.1137/22m1482299","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 575-601, May 2024. <br/> As key subjects in spectral geometry and combinatorial graph theory, respectively, the (continuous) Hodge Laplacian and the combinatorial Laplacian share similarities in revealing the topological dimension and geometric shape of data and in their realization of diffusion and minimization of harmonic measures. It is believed that they also both associate with vector calculus, through the gradient, curl, and divergence, as argued in the popular usage of “Hodge Laplacians on graphs” in the literature. Nevertheless, these Laplacians are intrinsically different in their domains of definitions and applicability to specific data formats, hindering any in-depth comparison of the two approaches. For example, the spectral decomposition of a vector field on a simple point cloud using combinatorial Laplacians defined on some commonly used simplicial complexes does not give rise to the same curl-free and divergence-free components that one would obtain from the spectral decomposition of a vector field using either the continuous Hodge Laplacians defined on differential forms in manifolds or the discretized Hodge Laplacians defined on a point cloud with boundary in the Eulerian representation or on a regular mesh in the Eulerian representation. To facilitate the comparison and bridge the gap between the combinatorial Laplacian and Hodge Laplacian for the discretization of continuous manifolds with boundary, we further introduce boundary-induced graph (BIG) Laplacians using tools from discrete exterior calculus (DEC). BIG Laplacians are defined on discrete domains with appropriate boundary conditions to characterize the topology and shape of data. The similarities and differences among the combinatorial Laplacian, BIG Laplacian, and Hodge Laplacian are then examined. Through an Eulerian representation of 3D domains as level-set functions on regular grids, we show experimentally the conditions for the convergence of BIG Laplacian eigenvalues to those of the Hodge Laplacian for elementary shapes.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"367 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141904538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Survey and Review","authors":"Marlis Hochbruck","doi":"10.1137/24n97592x","DOIUrl":"https://doi.org/10.1137/24n97592x","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 401-401, May 2024. <br/> In “Cardinality Minimization, Constraints, and Regularization: A Survey,\" Andreas M. Tillmann, Daniel Bienstock, Andrea Lodi, and Alexandra Schwartz consider a class of optimization problems that involve the cardinality of variable vectors in constraints or in the objective function. Such problems have many important applications, e.g., medical imaging (like X-ray tomography), face recognition, wireless sensor network design, stock picking, crystallography, astronomy, computer vision, classification and regression, interpretable machine learning, and statistical data analysis. The emphasis in this paper is on continuous variables, which distinguishes it from a myriad of classical operation research or combinatorial optimization problems. Three general problem classes are studied in detail: cardinality minimization problems, cardinality-constrained problems, and regularized cardinality problems. The paper provides a road map connecting several disciplines and offers an overview of many different computational approaches that are available for cardinality optimization problems. Since such problems are of cross-disciplinary nature, the authors organized their review according to specific application areas and point out overlaps and differences. The paper starts with prominent cardinality optimization problems, namely, signal and image processing, portfolio optimization and management, high-dimensional statistics and machine learning, and some related problems from combinatorics, matrix sparsification, and group/block sparsity. It then continues with exact models and solution methods. The further sections are devoted to relaxations and heuristics, scalability of exact and heuristic algorithms. The authors made a strong effort regarding the organization of their quite long paper, meaning that tables and figures guide the reader to an application or result of interest. In addition, they provide an extensive overview on the literature with more than 400 references.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"367 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141904644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Cardinality Minimization, Constraints, and Regularization: A Survey","authors":"Andreas M. Tillmann, Daniel Bienstock, Andrea Lodi, Alexandra Schwartz","doi":"10.1137/21m142770x","DOIUrl":"https://doi.org/10.1137/21m142770x","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 403-477, May 2024. <br/> We survey optimization problems that involve the cardinality of variable vectors in constraints or the objective function. We provide a unified viewpoint on the general problem classes and models, and we give concrete examples from diverse application fields such as signal and image processing, portfolio selection, and machine learning. The paper discusses general-purpose modeling techniques and broadly applicable as well as problem-specific exact and heuristic solution approaches. While our perspective is that of mathematical optimization, a main goal of this work is to reach out to and build bridges between the different communities in which cardinality optimization problems are frequently encountered. In particular, we highlight that modern mixed-integer programming, which is often regarded as impractical due to the commonly unsatisfactory behavior of black-box solvers applied to generic problem formulations, can in fact produce provably high-quality or even optimal solutions for cardinality optimization problems, even in large-scale real-world settings. Achieving such performance typically involves drawing on the merits of problem-specific knowledge that may stem from different fields of application and, e.g., can shed light on structural properties of a model or its solutions, or can lead to the development of efficient heuristics. We also provide some illustrative examples.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"30 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141904540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"SIGEST","authors":"The Editors","doi":"10.1137/24n975943","DOIUrl":"https://doi.org/10.1137/24n975943","url":null,"abstract":"SIAM Review, Volume 66, Issue 3, Page 533-533, May 2024. <br/> The SIGEST article in this issue is “Operator Learning Using Random Features: A Tool for Scientific Computing,” by Nicholas H. Nelsen and Andrew M. Stuart. This work considers the problem of operator learning in infinite-dimensional Banach spaces through the use of random features. The driving application is the approximation of solution operators to partial differential equations (PDEs), here foremost time-dependent problems, that are naturally posed in an infinite-dimensional function space. Typically here, in contrast to the mainstream big data regimes of machine learning applications such as computer vision, high resolution data coming from physical experiments or from computationally expensive simulations of such differential equations is usually small. Fast and approximate surrogates built from such data can be advantageous in building forward models for inverse problems or for doing uncertainty quantification, for instance. Showing how this can be done in infinite dimensions gives rise to approximators which are at the outset resolution and discretization invariant, allowing training on one resolution and deploying on another. At the heart of this work is the function-valued random features methodology that the authors extended from the finite setting of the classical random features approach. Here, the nonlinear operator is approximated by a linear combination of random operators which turn out to be a low-rank approximation and whose computation amounts to a convex, quadratic optimisation problem that is efficiently solvable and for which convergence guarantees can be derived. The methodology is then concretely applied to two concrete PDE examples: Burgers' equations and Darcy flow, demonstrating the applicability of the function-valued random features method, its scalability, discretization invariance, and transferability. The original 2021 article, which appeared in SIAM's Journal on Scientific Computing, has attracted considerable attention. In preparing this SIGEST version, the authors have made numerous modifications and revisions. These include expanding the introductory section and the concluding remarks, condensing the technical content and making it more accessible, and adding a link to an open access GitHub repository that contains all data and code used to produce the results in the paper.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"64 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141904646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Survey and Review","authors":"Marlis Hochbruck","doi":"10.1137/24n975876","DOIUrl":"https://doi.org/10.1137/24n975876","url":null,"abstract":"SIAM Review, Volume 66, Issue 2, Page 203-203, May 2024. <br/> Inverse problems arise in various applications---for instance, in geoscience, biomedical science, or mining engineering, to mention just a few. The purpose is to recover an object or phenomenon from measured data which is typically subject to noise. The article “Computational Methods for Large-Scale Inverse Problems: A Survey on Hybrid Projection Methods,” by Julianne Chung and Silvia Gazzola, focuses on large, mainly linear, inverse problems. The mathematical modeling of such problems results in a linear system with a very large matrix $A in mathbb{R}^{mtimes n}$ and a perturbed right-hand side. In some applications, it is not even possible to store the matrix, and thus algorithms which only use $A$ in the form of matrix-vector products $Ax$ or $A^Tx$ are the only choice. The article starts with two examples from image deblurring and tomographic reconstruction illustrating the challenges of inverse problems. It then presents the basic idea of regularization which consists of augmenting the model by additional information. Two variants of regularization methods are considered in detail, namely, variational and iterative methods. For variational methods it is crucial to know a good regularization parameter in advance. Unfortunately, its estimation can be expensive. On the other hand, iterative schemes, such as Krylov subspace methods, regularize by early termination of the iterations. Hybrid methods combine these two approaches leveraging the best features of each class. The paper focuses on hybrid projection methods. Here, one starts with a Krylov process in which the original problem is projected onto a low-dimensional subspace. The projected problem is then solved using a variational regularization method. The paper reviews the most relevant direct and iterative regularization techniques before it provides details on the two main building blocks of hybrid methods, namely, generating a subspace for the solution and solving the projected problem. It covers theoretical as well as numerical aspects of these schemes and also presents some extensions of hybrid methods: more general Tikhonov problems, nonstandard projection methods (enrichment, augmentation, recycling), $ell_p$ regularization, Bayesian setting, and nonlinear problems. In addition, relevant software packages are provided. The presentation is very clear and the paper is also readable for those who are not experts in the field. Hence, it is valuable for everyone interested in large-scale inverse problems.","PeriodicalId":49525,"journal":{"name":"SIAM Review","volume":"17 1","pages":""},"PeriodicalIF":10.2,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140902936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}