{"title":"检测系统测试","authors":"G. Leach","doi":"10.1109/CCST.1995.524741","DOIUrl":null,"url":null,"abstract":"The phrase \"probability of detection\" (P/sub d/) is often misused in the context of exterior electronic perimeter intrusion detection systems (PIDS). For example, a system which correctly detects when tested three times has detected at a rate of 100%, but might not have a \"probability of detection\" of 100%. \"P/sub d/\" is often misused to describe this experimental result as a 100% probability of detection. \"Confidence limits\" for P/sub d/ can be estimated and minimum extents for testing can then be demanded. These confidence limits are sometimes calculated using the normal, or the chi-squared, statistical distributions. Using these distributions for PIDS testing is questionable because they are often used outside their region of validity. There are fundamental constraints which obstruct conventional statistical confidence limits for P/sub d/ from being found. P/sub d/ statistics are discussed and an exact way to express detection uncertainty using the binomial distribution is described. Ways to reduce testing, yet maintain confidence, are discussed. Experts are concerned that extensive, but unrepresentative, testing gives an unwarranted impression of reliability. This paper emphasises the importance of representative testing and the clear presentation of results.","PeriodicalId":376576,"journal":{"name":"Proceedings The Institute of Electrical and Electronics Engineers. 29th Annual 1995 International Carnahan Conference on Security Technology","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1995-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Testing of detection systems\",\"authors\":\"G. Leach\",\"doi\":\"10.1109/CCST.1995.524741\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The phrase \\\"probability of detection\\\" (P/sub d/) is often misused in the context of exterior electronic perimeter intrusion detection systems (PIDS). For example, a system which correctly detects when tested three times has detected at a rate of 100%, but might not have a \\\"probability of detection\\\" of 100%. \\\"P/sub d/\\\" is often misused to describe this experimental result as a 100% probability of detection. \\\"Confidence limits\\\" for P/sub d/ can be estimated and minimum extents for testing can then be demanded. These confidence limits are sometimes calculated using the normal, or the chi-squared, statistical distributions. Using these distributions for PIDS testing is questionable because they are often used outside their region of validity. There are fundamental constraints which obstruct conventional statistical confidence limits for P/sub d/ from being found. P/sub d/ statistics are discussed and an exact way to express detection uncertainty using the binomial distribution is described. Ways to reduce testing, yet maintain confidence, are discussed. Experts are concerned that extensive, but unrepresentative, testing gives an unwarranted impression of reliability. This paper emphasises the importance of representative testing and the clear presentation of results.\",\"PeriodicalId\":376576,\"journal\":{\"name\":\"Proceedings The Institute of Electrical and Electronics Engineers. 29th Annual 1995 International Carnahan Conference on Security Technology\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"1995-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings The Institute of Electrical and Electronics Engineers. 29th Annual 1995 International Carnahan Conference on Security Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CCST.1995.524741\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings The Institute of Electrical and Electronics Engineers. 29th Annual 1995 International Carnahan Conference on Security Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCST.1995.524741","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The phrase "probability of detection" (P/sub d/) is often misused in the context of exterior electronic perimeter intrusion detection systems (PIDS). For example, a system which correctly detects when tested three times has detected at a rate of 100%, but might not have a "probability of detection" of 100%. "P/sub d/" is often misused to describe this experimental result as a 100% probability of detection. "Confidence limits" for P/sub d/ can be estimated and minimum extents for testing can then be demanded. These confidence limits are sometimes calculated using the normal, or the chi-squared, statistical distributions. Using these distributions for PIDS testing is questionable because they are often used outside their region of validity. There are fundamental constraints which obstruct conventional statistical confidence limits for P/sub d/ from being found. P/sub d/ statistics are discussed and an exact way to express detection uncertainty using the binomial distribution is described. Ways to reduce testing, yet maintain confidence, are discussed. Experts are concerned that extensive, but unrepresentative, testing gives an unwarranted impression of reliability. This paper emphasises the importance of representative testing and the clear presentation of results.