ChatGPT-powered deep learning: elevating brain tumor detection in MRI scans

PurposeAccurate diagnosis of brain tumors is crucial for effective treatment and improved patient outcomes. Magnetic resonance imaging (MRI) is a common method for detecting brain malignancies, but interpreting MRI data can be challenging and time-consuming for healthcare professionals.Design/methodology/approachAn innovative method is presented that combines deep learning (DL) models with natural language processing (NLP) from ChatGPT to enhance the accuracy of brain tumor detection in MRI scans. The method generates textual descriptions of brain tumor regions, providing clinicians with valuable insights into tumor characteristics for informed decision-making and personalized treatment planning.FindingsThe evaluation of this approach demonstrates promising outcomes, achieving a notable Dice coefficient score of 0.93 for tumor segmentation, outperforming current state-of-the-art methods. Human validation of the generated descriptions confirms their precision and conciseness.Research limitations/implicationsWhile the method showcased advancements in accuracy and understandability, ongoing research is essential for refining the model and addressing limitations in segmenting smaller or atypical tumors.Originality/valueThese results emphasized the potential of this innovative method in advancing neuroimaging practices and contributing to the effective detection and management of brain tumors.