A holistic trustworthy AI pipeline for building trusted AI-enabled applications

Abstract

Abstract AI-enabled applications have achieved widespread adoption for complex problem-solving and informed decision-making. However, growing concerns regarding AI system failures that lead to bias, inequalities, and untrustworthy outcomes necessitate a move beyond performance evaluation to ensure trustworthy, equitable decisions. Although existing practices identify key trustworthiness characteristics, they lack a unified pipeline for systematically aligning these traits across the development lifecycle. To address this gap, this work presents a novel holistic Trustworthy AI (T-AI) pipeline that integrates six key characteristics—privacy, fairness, security, robustness, safety, and explainability—into specific development phases. To formally govern this integration, we introduce a novel Adaptive Trustworthiness Integration (ATI) algorithm, which enforces an irreversibility-based ordering of characteristics and applies conditional gating at each phase boundary to prevent propagation of unresolved violations, producing an empirically measured inter-characteristic trade-off matrix that makes intervention costs and benefits transparent and reproducible. The pipeline is validated through two experiments: an industrial pilot at Fraunhofer IBMT, extended with multi-seed validation across three seeds and a large-scale public microscopy benchmark (PanNuke; 7,904 images), achieving 99.5% mAP@50; and a healthcare experiment using the Synthea dataset, maintaining 89.5% predictive accuracy. These results demonstrate that the pipeline reduces demographic fairness gaps from 46% to under 5%, achieves a 0% rate of clinically dangerous hallucinations via a four-layer safety architecture, and confirms consistent trustworthiness guarantees across datasets and random initialisations. Ultimately, this work advances United Nations Sustainable Development Goal 9 by ensuring fair and privacy-preserving data collection, preventing system failures through adversarial hardening, and enabling transparent decision-making.