{"title":"Performance Benchmarking With the Austin RCS Benchmark Suite: Beyond empirical verification and validation","authors":"Andrew Maicke;Jon T. Kelley;Ali E. Yilmaz","doi":"10.1109/MAP.2025.3537557","DOIUrl":null,"url":null,"abstract":"The realized performance (error–cost tradeoff) of three computational electromagnetic (CEM) methods, which use parallel algorithms on a supercomputer to predict the radar cross section (RCS) of complex targets, are quantified using the Austin RCS Benchmark Suite. The article demonstrates how modern benchmark suites can be used to evaluate CEM methods empirically and compare their performances objectively. <p>The Austin RCS Benchmark Suite <xref>[1]</xref>, <xref>[2]</xref> has recently been populated with 20 carefully selected problem sets that span a wide range in six dimensions of computational difficulty <xref>[3]</xref>.</p>","PeriodicalId":13090,"journal":{"name":"IEEE Antennas and Propagation Magazine","volume":"67 2","pages":"95-108"},"PeriodicalIF":4.2000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Antennas and Propagation Magazine","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10973226/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
The realized performance (error–cost tradeoff) of three computational electromagnetic (CEM) methods, which use parallel algorithms on a supercomputer to predict the radar cross section (RCS) of complex targets, are quantified using the Austin RCS Benchmark Suite. The article demonstrates how modern benchmark suites can be used to evaluate CEM methods empirically and compare their performances objectively.
The Austin RCS Benchmark Suite [1], [2] has recently been populated with 20 carefully selected problem sets that span a wide range in six dimensions of computational difficulty [3].
期刊介绍:
IEEE Antennas and Propagation Magazine actively solicits feature articles that describe engineering activities taking place in industry, government, and universities. All feature articles are subject to peer review. Emphasis is placed on providing the reader with a general understanding of either a particular subject or of the technical challenges being addressed by various organizations, as well as their capabilities to cope with these challenges. Articles presenting new results, review, tutorial, and historical articles are welcome, as are articles describing examples of good engineering. The technical field of interest of the Magazine is the same as the IEEE Antennas and Propagation Society, and includes the following: antennas, including analysis, design, development, measurement, and testing; radiation, propagation, and the interaction of electromagnetic waves with discrete and continuous media; and applications and systems pertinent to antennas, propagation, and sensing, such as applied optics, millimeter- and sub-millimeter-wave techniques, antenna signal processing and control, radio astronomy, and propagation and radiation aspects of terrestrial and space-based communication, including wireless, mobile, satellite, and telecommunications.