Data-centric artificial intelligence and cancer research: construction of a real-world head and neck treatment data repository

Background and purpose

The performance and generalisability of machine learning (ML) models relies on high-quality data. Retrospective and prospective collection of high-quality data for research use while respecting data protection and patient privacy remains a challenge in the clinical environment. Currently, months of laborious extraction and clinical annotation are often necessary before data analysis can begin. We present a novel institutional federated data lake, utilising open-source software, to facilitate efficient production of ML models from head and neck cancer (HNC) imaging and radiotherapy (RT) data. This structured pipeline dramatically reduces the time associated with the production of ML models and real-world evidence generation. This paper describes our governance-compliant processes and provides a framework for establishing similar databases.

Materials and methods

Extensible NeuroImaging Archival Toolkit (XNAT) is a powerful open-source imaging platform. Within our department, it forms a part of the local secure enclave for the purposes of federated learning in artificial intelligence projects and provides import, archiving, processing, search and secure distribution facilities for imaging and RT data.

Results

We have created a clinically annotated, carefully curated, data lake of 2895 consenting HNC patients containing 22 170 relevant diagnostic, staging, treatment and monitoring imaging sets. Key recommendations for replication include infrastructure planning, robust patient and data selection criteria and prioritising patient consent and privacy.

Conclusions

This secure and extensible imaging and HNC RT cancer database setup promises to be an exceedingly useful tool for research, revolutionising the time and cost associated with the production of ML models, making the process safer, faster and more efficient.