Automated detection of cervical spondylotic myelopathy: harnessing the power of natural language processing.

Abstract

Background: The objective of this study was to develop machine learning (ML) algorithms utilizing natural language processing (NLP) techniques for the automated detection of cervical spondylotic myelopathy (CSM) through the analysis of positive symptoms in free-text admission notes. This approach enables the timely identification and management of CSM, leading to optimal outcomes.

Methods: The dataset consisted of 1,214 patients diagnosed with cervical diseases as their primary condition between June 2013 and June 2020. A random ratio of 7:3 was employed to partition the dataset into training and testing subsets. Two machine learning models, Extreme Gradient Boosting (XGBoost) and Bidirectional Long Short Term Memory Network (LSTM), were developed. The performance of these models was assessed using various metrics, including the Receiver Operating Characteristic (ROC) curve, Area Under the Curve (AUC), accuracy, precision, recall, and F1 score.

Results: In the testing set, the LSTM achieved an AUC of 0.9025, an accuracy of 0.8740, a recall of 0.9560, an F1 score of 0.9122, and a precision of 0.8723. The LSTM model demonstrated superior clinical applicability compared to the XGBoost model, as evidenced by calibration curves and decision curve analysis.

Conclusions: The timely identification of suspected CSM allows for prompt confirmation of diagnosis and treatment. The utilization of NLP algorithm demonstrated excellent discriminatory capabilities in identifying CSM based on positive symptoms in free-text admission notes complaint data. This study showcases the potential of a pre-diagnosis system in the field of spine.