Adam T. Biggs, Joseph A. Hamilton, Greg Huffman, R. Markwald
{"title":"致命性悖论:古德哈特定律和衡量致命性的挑战","authors":"Adam T. Biggs, Joseph A. Hamilton, Greg Huffman, R. Markwald","doi":"10.1177/15485129231165527","DOIUrl":null,"url":null,"abstract":"Military performance must be evaluated, and one of the most critical concepts to measure involves the lethal capabilities of a military force. However, there are multiple challenges that complicate any accurate performance assessment, including theoretical issues of measurement due to statistical irregularities and practical limitations due to the military context. Here, we describe the lethality paradox, which states that measuring lethality could be a self-defeating exercise despite its necessity. Specifically, the value of any collected metric may be inherently reduced by the act of measurement while, also, creating operational vulnerabilities for a military force. This paradox is conceived as an extension of Goodhart’s Law and incorporates the same challenges of a personnel gaming a set standard rather than developing the skill set supposedly measured by this standard. Our discussion identifies the limitations and applications of Goodhart’s Law to lethality while also concluding with several proposed solutions to different paradoxical challenges.","PeriodicalId":44661,"journal":{"name":"Journal of Defense Modeling and Simulation-Applications Methodology Technology-JDMS","volume":null,"pages":null},"PeriodicalIF":1.0000,"publicationDate":"2023-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The lethality paradox: Goodhart’s Law and the challenge of measuring lethality\",\"authors\":\"Adam T. Biggs, Joseph A. Hamilton, Greg Huffman, R. Markwald\",\"doi\":\"10.1177/15485129231165527\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Military performance must be evaluated, and one of the most critical concepts to measure involves the lethal capabilities of a military force. However, there are multiple challenges that complicate any accurate performance assessment, including theoretical issues of measurement due to statistical irregularities and practical limitations due to the military context. Here, we describe the lethality paradox, which states that measuring lethality could be a self-defeating exercise despite its necessity. Specifically, the value of any collected metric may be inherently reduced by the act of measurement while, also, creating operational vulnerabilities for a military force. This paradox is conceived as an extension of Goodhart’s Law and incorporates the same challenges of a personnel gaming a set standard rather than developing the skill set supposedly measured by this standard. Our discussion identifies the limitations and applications of Goodhart’s Law to lethality while also concluding with several proposed solutions to different paradoxical challenges.\",\"PeriodicalId\":44661,\"journal\":{\"name\":\"Journal of Defense Modeling and Simulation-Applications Methodology Technology-JDMS\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.0000,\"publicationDate\":\"2023-06-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Defense Modeling and Simulation-Applications Methodology Technology-JDMS\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/15485129231165527\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Defense Modeling and Simulation-Applications Methodology Technology-JDMS","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/15485129231165527","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
The lethality paradox: Goodhart’s Law and the challenge of measuring lethality
Military performance must be evaluated, and one of the most critical concepts to measure involves the lethal capabilities of a military force. However, there are multiple challenges that complicate any accurate performance assessment, including theoretical issues of measurement due to statistical irregularities and practical limitations due to the military context. Here, we describe the lethality paradox, which states that measuring lethality could be a self-defeating exercise despite its necessity. Specifically, the value of any collected metric may be inherently reduced by the act of measurement while, also, creating operational vulnerabilities for a military force. This paradox is conceived as an extension of Goodhart’s Law and incorporates the same challenges of a personnel gaming a set standard rather than developing the skill set supposedly measured by this standard. Our discussion identifies the limitations and applications of Goodhart’s Law to lethality while also concluding with several proposed solutions to different paradoxical challenges.