Rémi Florquin, Renaud Florquin, Denis Schmartz, Philippe Dony, Giovanni Briganti
{"title":"Pediatric cardiac surgery: machine learning models for postoperative complication prediction.","authors":"Rémi Florquin, Renaud Florquin, Denis Schmartz, Philippe Dony, Giovanni Briganti","doi":"10.1007/s00540-024-03377-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Managing children undergoing cardiac surgery with cardiopulmonary bypass (CPB) presents a significant challenge for anesthesiologists. Machine Learning (ML)-assisted tools have the potential to enhance the recognition of patients at risk of complications and predict potential issues, ultimately improving outcomes.</p><p><strong>Methods: </strong>We evaluated the prediction capacity of six models, ranging from logistic regression to support vector machine, using a dataset comprising 33 variables and 1364 subjects. The Area Under the Curve (AUC) and the F1 score served as the primary evaluation metrics. Our primary objectives were twofold: first, to develop an effective prediction model, and second, to create a user-friendly comprehensive model for identifying high-risk patients.</p><p><strong>Results: </strong>The logistic regression model demonstrated the highest effectiveness, achieving an AUC of 83.65%, and an F1 score of 0.7296, with balanced sensitivity and specificity of 77.94% and 76.47%, respectively. In comparison, the comprehensive three-layer decision tree model achieved an AUC of 72.84%, with sensitivity (79.41%) comparable to more complex models.</p><p><strong>Conclusion: </strong>Our machine learning-assisted tools provide an additional perspective and enhance the predictive capabilities of traditional scoring methods. These tools can assist anesthesiologists in making well-informed decisions. Furthermore, we have successfully demonstrated the feasibility of creating a practical white-box model. The next steps involve conducting clinical validation and multicenter cross-validation.</p><p><strong>Trial registration: </strong>NCT05537168.</p>","PeriodicalId":14997,"journal":{"name":"Journal of Anesthesia","volume":null,"pages":null},"PeriodicalIF":2.8000,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Anesthesia","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00540-024-03377-7","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ANESTHESIOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Managing children undergoing cardiac surgery with cardiopulmonary bypass (CPB) presents a significant challenge for anesthesiologists. Machine Learning (ML)-assisted tools have the potential to enhance the recognition of patients at risk of complications and predict potential issues, ultimately improving outcomes.
Methods: We evaluated the prediction capacity of six models, ranging from logistic regression to support vector machine, using a dataset comprising 33 variables and 1364 subjects. The Area Under the Curve (AUC) and the F1 score served as the primary evaluation metrics. Our primary objectives were twofold: first, to develop an effective prediction model, and second, to create a user-friendly comprehensive model for identifying high-risk patients.
Results: The logistic regression model demonstrated the highest effectiveness, achieving an AUC of 83.65%, and an F1 score of 0.7296, with balanced sensitivity and specificity of 77.94% and 76.47%, respectively. In comparison, the comprehensive three-layer decision tree model achieved an AUC of 72.84%, with sensitivity (79.41%) comparable to more complex models.
Conclusion: Our machine learning-assisted tools provide an additional perspective and enhance the predictive capabilities of traditional scoring methods. These tools can assist anesthesiologists in making well-informed decisions. Furthermore, we have successfully demonstrated the feasibility of creating a practical white-box model. The next steps involve conducting clinical validation and multicenter cross-validation.
期刊介绍:
The Journal of Anesthesia is the official journal of the Japanese Society of Anesthesiologists. This journal publishes original articles, review articles, special articles, clinical reports, short communications, letters to the editor, and book and multimedia reviews. The editors welcome the submission of manuscripts devoted to anesthesia and related topics from any country of the world. Membership in the Society is not a prerequisite.
The Journal of Anesthesia (JA) welcomes case reports that show unique cases in perioperative medicine, intensive care, emergency medicine, and pain management.