A proposed benchmark unit for evaluating electronic troubleshooting expert systems

Abstract

In order to establish a uniform basis for comparing and evaluating diagnostic expert systems for functional electronic troubleshooting, a real-life benchmark unit is proposed. The HP-3478P unit is essentially identical to the HP-3478A digital multimeter. The authors first outline the criteria that guided them in the selection of this unit from a wide variety of real-life units. They describe the structure of the HP-3478P and its test set. They then provide an illustrative test case and a discussion of the complexity of the unit. The HP-3478P was used to evaluate the AITEST system on a wide variety of cases, and it was found to be very useful.<>