Explainable 3D multi-scale movement quantification automates motor assessments and estimates Parkinson’s disease duration

Abstract

Abstract Quantitative assessment of motor impairment in Parkinson’s disease (PD) remains limited, particularly in tracking how deficits evolve over time. Current bedside scoring systems, including the Movement Disorder Society Unified Parkinson’s Disease Rating Scale (MDS-UPDRS), capture clinically important observations but condense them into categorical, semi-subjective ratings. This manual scoring process is imprecise, limiting diagnostic and prognostic accuracy and hindering our understanding of PD impairments and their progression. While there have been recent efforts to improve scoring via sensor-based measurements and machine learning, these approaches have limitations impeding their utility and clinical adoption. In principle, video-based methods enable comprehensive quantification and monitoring of motor function, but previous approaches largely have used imprecise 2D movement features, analyzed only individual motor tasks, and not addressed disease progression. Here, we introduce an interpretable, quantitative framework built on a synchronized, markerless 3D pose tracking system. We recorded three routinely performed MDS-UPDRS motor tasks from a large cohort of patients with PD and healthy subjects, and extracted task-level, clinically explainable kinematic features. These activities probed complementary motor subsystems—fine hand, forearm rotation, and whole-body locomotion—offering a concise yet comprehensive view of PD motor function. From 3D poses, we developed how movement patterns differed between PD and healthy subjects and how these patterns shifted as PD progressed to form distinct movement characteristics. Using machine learning models combining 3D motor features from multiple activities across multiple spatiotemporal scales, we also automatically classified diagnostic status, duration-defined PD severity, and inferred time since diagnosis. These results establish a transparent digital-biomarker framework that may support future longitudinal monitoring of PD in clinics and trials.