Validating medical digital twins for clinical decision support: beyond predictive accuracy.

Abstract

Objective: To clarify how validation requirements should be specified for medical digital twins used in clinical decision support, particularly when such systems are intended to compare interventions, treatment timings, dosages, or sequential care strategies.

Perspective: Medical digital twins are heterogeneous systems that may combine prediction, simulation, mechanistic modeling, machine learning, data assimilation, uncertainty quantification, and decision-support functions. Their evaluation should therefore be driven by their intended use rather than by a single definition of what a digital twin is. For digital twins used primarily for visualization, monitoring, or short-term forecasting, predictive accuracy, calibration, discrimination, and robustness may be the central validation targets. However, when digital twins are used to support intervention-oriented clinical decisions, retrospective accuracy under historical clinical practice is insufficient on its own.

Key message: Intervention-oriented digital twins address action-conditioned questions: what is predicted to happen under specified alternative actions, assumptions, time horizons, and clinical contexts. Their validation should therefore extend beyond scalar performance metrics to include uncertainty representation, updating stability, robustness under regime change, action-regime validity, counterfactual consistency, clinically weighted error, and decision-level consequences. This requires drawing on established traditions in forecast verification, causal inference, uncertainty quantification, model verification and validation, decision theory, control theory, and post-deployment monitoring. The level of causal or mechanistic support required should match the clinical claim being made, whether at the genotype, phenotype, physiological, or care-process level.

Conclusion: The scientific-instrument framing is proposed as a pragmatic validation lens for intervention-oriented digital twins, not as a universal definition of digital twins. It helps define the scope within which their outputs can support clinical reasoning. Medical digital twins should be accompanied by explicit validation statements specifying their target population, prediction horizon, supported interventions, uncertainty bounds, and known failure conditions.