Evaluating AI-ESTATE standards compliance using a functional intelligence ratio

Abstract

Recent work by the IEEE Standards Coordinating Committee 20 (SCC-20) has included the specification of standards for artificially intelligent automatic test equipment (ATE). The SCC-20 established a subcommittee known as AI-ESTATE (artificial intelligence expert system tie to automatic test equipment). The authors propose a new approach to evaluating AI based ATE systems under AI-ESTATE using a weighted evaluation function based upon the functional capabilities of the AI system called the functional intelligence ratio (FIR). They describe the problems associated with evaluating AI systems, describe the role of AI-ESTATE as part of SCC-20, and present the FIR with a sample list of base requirements.<>