使国防部的未来能够测试和评估人工智能系统

IF 1.6 4区工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC

IEEE Instrumentation & Measurement Magazine Pub Date : 2023-08-01 DOI:10.1109/MIM.2023.10208252

F. Reeder, Carol Pomales, Diane M. Kotras, James Lockett

{"title":"使国防部的未来能够测试和评估人工智能系统","authors":"F. Reeder, Carol Pomales, Diane M. Kotras, James Lockett","doi":"10.1109/MIM.2023.10208252","DOIUrl":null,"url":null,"abstract":"While of great potential benefit, Artificial Intelligence (AI) presents new challenges and exacerbates some existing ones for the Department of Defense (DoD) Test and Evaluation (T&E) community. T&E professionals will need to work to ensure that AI-enabled systems' (AIES) complex and variable nature can be sufficiently characterized by the boundaries of acceptable performance. To help the DoD understand and prepare for the challenges of T&E of AIES, we convened a group of AI adoption, AI development, and policy experts to develop a future vision of T&E with respect to AI. The result is a vision of T&E that incorporates the unique requirements for AIES, encompassing policy changes, user engagement approaches, measures and metrics, data, infrastructure, and cybersecurity. This future vision is accomplishable by identifying focus for efforts across DoD, academia, Federally Funded Research and Development Centers (FFRDCs) and industry to provide processes, policy/standards, tools, data, and infrastructure. Thus, we can assure a more feasible future for the T&E of AIES.","PeriodicalId":55025,"journal":{"name":"IEEE Instrumentation & Measurement Magazine","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enabling the Department of Defense's Future to Test and Evaluate Artificial Intelligence Enabled Systems\",\"authors\":\"F. Reeder, Carol Pomales, Diane M. Kotras, James Lockett\",\"doi\":\"10.1109/MIM.2023.10208252\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"While of great potential benefit, Artificial Intelligence (AI) presents new challenges and exacerbates some existing ones for the Department of Defense (DoD) Test and Evaluation (T&E) community. T&E professionals will need to work to ensure that AI-enabled systems' (AIES) complex and variable nature can be sufficiently characterized by the boundaries of acceptable performance. To help the DoD understand and prepare for the challenges of T&E of AIES, we convened a group of AI adoption, AI development, and policy experts to develop a future vision of T&E with respect to AI. The result is a vision of T&E that incorporates the unique requirements for AIES, encompassing policy changes, user engagement approaches, measures and metrics, data, infrastructure, and cybersecurity. This future vision is accomplishable by identifying focus for efforts across DoD, academia, Federally Funded Research and Development Centers (FFRDCs) and industry to provide processes, policy/standards, tools, data, and infrastructure. Thus, we can assure a more feasible future for the T&E of AIES.\",\"PeriodicalId\":55025,\"journal\":{\"name\":\"IEEE Instrumentation & Measurement Magazine\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2023-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Instrumentation & Measurement Magazine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1109/MIM.2023.10208252\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Instrumentation & Measurement Magazine","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1109/MIM.2023.10208252","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}

引用次数: 0

摘要

虽然人工智能具有巨大的潜在效益，但它给国防部测试与评估（T&E）社区带来了新的挑战，并加剧了一些现有的挑战。T&E专业人员需要努力确保人工智能系统（AIES）的复杂性和可变性能够通过可接受性能的边界来充分表征。为了帮助国防部理解并准备应对AIES T&E的挑战，我们召集了一组人工智能采用、人工智能开发和政策专家，以制定人工智能T&E的未来愿景。其结果是，T&E愿景融合了AIES的独特要求，包括政策变化、用户参与方法、措施和指标、数据、基础设施，以及网络安全。通过确定国防部、学术界、联邦资助的研发中心（FFRDCs）和工业界提供流程、政策/标准、工具、数据和基础设施的工作重点，可以实现这一未来愿景。因此，我们可以确保AIES的T&E有一个更可行的未来。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Enabling the Department of Defense's Future to Test and Evaluate Artificial Intelligence Enabled Systems

While of great potential benefit, Artificial Intelligence (AI) presents new challenges and exacerbates some existing ones for the Department of Defense (DoD) Test and Evaluation (T&E) community. T&E professionals will need to work to ensure that AI-enabled systems' (AIES) complex and variable nature can be sufficiently characterized by the boundaries of acceptable performance. To help the DoD understand and prepare for the challenges of T&E of AIES, we convened a group of AI adoption, AI development, and policy experts to develop a future vision of T&E with respect to AI. The result is a vision of T&E that incorporates the unique requirements for AIES, encompassing policy changes, user engagement approaches, measures and metrics, data, infrastructure, and cybersecurity. This future vision is accomplishable by identifying focus for efforts across DoD, academia, Federally Funded Research and Development Centers (FFRDCs) and industry to provide processes, policy/standards, tools, data, and infrastructure. Thus, we can assure a more feasible future for the T&E of AIES.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

IEEE Instrumentation & Measurement Magazine 工程技术-工程：电子与电气

CiteScore

4.20

自引率

4.80%

发文量

147

审稿时长

>12 weeks

期刊介绍： IEEE Instrumentation & Measurement Magazine is a bimonthly publication. It publishes in February, April, June, August, October, and December of each year. The magazine covers a wide variety of topics in instrumentation, measurement, and systems that measure or instrument equipment or other systems. The magazine has the goal of providing readable introductions and overviews of technology in instrumentation and measurement to a wide engineering audience. It does this through articles, tutorials, columns, and departments. Its goal is to cross disciplines to encourage further research and development in instrumentation and measurement.