Formula-S: Situated Visualization for Traditional Chinese Medicine Formula Learning

Abstract

Objective

The study of medicine formulas is a core component of traditional Chinese medicine (TCM), yet traditional learning methods often lack interactivity and contextual understanding, making it challenging for beginners to grasp the intricate composition rules of formulas. To address this gap, we introduce Formula-S, a situated visualization method for TCM formula learning in augmented reality (AR) and evaluate its performance. This study aims to evaluate the effectiveness of Formula-S in enhancing TCM formula learning for beginners by comparing it with traditional text-based formula learning and web-based visualization.

Methods

Formula-S is an interactive AR tool designed for TCM formula learning, featuring three modes (3D, Web, and Table). The dataset included TCM formulas and herb properties extracted from authoritative references, including textbook and the SymMap database. In Formula-S, the hierarchical visualization of the formulas as herbal medicine compositions, is linked to the multidimensional herb attribute visualization and embedded in the real world, where real herb samples are presented. To evaluate its effectiveness, a controlled study (n=30) was conducted. Participants who had no formal TCM knowledge were tasked with herbal medicine identification, formula composition, and recognition. In the study, participants interacted with the AR tool through HoloLens 2. Data were collected on both task performance (accuracy and response time) and user experience, with a focus on task efficiency, accuracy, and user preference across the different learning modes.

Results

The situated visualization method of Formula-S had comparable accuracy to other methods but shorter response time for herbal formula learning tasks. Regarding user experience, our new approach demonstrated the highest system usability and lowest task load, effectively reducing cognitive load and allowing users to complete tasks with greater ease and efficiency. Participants reported that Formula-S enhanced their learning experience through its intuitive interface and immersive AR environment, suggesting this approach offers usability advantages for TCM education.

Conclusions

The situated visualization method in Formula-S offers more efficient and accurate searching capabilities compared to traditional and web-based methods. Additionally, it provides superior contextual understanding of TCM formulas, making it a promising new solution for TCM learning.