From intensive care monitors to cloud environments: a structured data pipeline for advanced clinical decision support.

Abstract

Background: Clinical decision-making is increasingly shifting towards data-driven approaches and requires large databases to develop state-of-the-art algorithms for diagnosing, detecting and predicting diseases. The intensive care unit (ICU), a data-rich setting, faces challenges with high-frequency, unstructured monitor data. Here, we showcase a successful example of a data pipeline to efficiently move patient data to the cloud environment for structured storage. This supports individual patient analysis, enables largescale retrospective research, and the development of data-driven algorithms.

Methods: Since June 2021, ICU data of the Amsterdam UMC have been collected and stored in a third-party cloud environment which is hosted on large virtual servers. The feasibility of the pipeline will be demonstrated with the available data through research and clinical use cases. Furthermore, privacy, safety, data quality, and environmental impact are carefully considered in the cloud storage transition.

Findings: Over two years, data from over 9000 patients have been stored in the cloud. The availability, agility, computational power, high uptime, and streaming data pipelines allow for large retrospective analyses as well as the opportunity to implement real-time prediction of critical events with machine learning algorithms. Critical events can be accessed by applying keyword search in the natural language data, annotated by the treating team. Besides, the cloud environment offers storage of institutional data enabling evaluation of healthcare.

Interpretation: The combined data and features of cloud environments offer support for predictive algorithm development and implementation, healthcare evaluation, and improved individual patient care.

Funding: University of Amsterdam Research Priority Agenda Program AI for Heath Decision-Making.