Development of Camera built-in Stethoscope Device for AR-Based Auscultation Training Simulator

: Current auscultatory training is constructed by using simulated patients (SPs) and auscultatory training mannequins. Through this method can perform training with various biological sounds, it has several disadvantages: communication between patients and doc-tors is inconvenient in the training; lack of reality; movement and installation are difficult. We have proposed the system called EARS (Educational Augmented Reality auscultation System) which can reproduce cardiovascular and pulmonary sounds to SPs by using augmented reality technology. This system makes it possible to train medical interviews and auscultatory techniques to SPs. Conventional EARS has disadvantages that installation is complicated, limited to use of sitting position only, and malfunction may occur due to blocking of infrared light by occlusion. In this research, we produced stethoscope device integrating camera, infrared light source, synchronization circuit, wired voice communication circuit, OLED (Organic Light Emitting Diode) panel. We also propose a method to detect the position of stethoscope in any posture of SPs. That make the new system easier to install and reduces the restriction on the posture. By evaluating the operational stability and positional detection accuracy comparing with the conventional EARS system, it is confirmed that the proposed system has significantly improved performance.