Jin K Kim, Kurt A McCammon, Kellie J Kim, Mandy Rickard, Armando J Lorenzo, Michael E Chua
{"title":"开发和使用机器学习模型预测男性吊带成功率——概念验证机构评估。","authors":"Jin K Kim, Kurt A McCammon, Kellie J Kim, Mandy Rickard, Armando J Lorenzo, Michael E Chua","doi":"10.5489/cuaj.8265","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>For mild to moderate male stress urinary incontinence (SUI), transobturator male slings remain an effective option for management. We aimed to use a machine learning (ML )-based model to predict those who will have a long-term success in managing SUI with male sling.</p><p><strong>Methods: </strong>All transobturator male sling cases from August 2006 to June 2012 by a single surgeon were reviewed. Outcome of interest was defined as 'cure': complete dryness with 0 pads used, without the need for additional procedures. Clinical variables included in ML models were: number of pads used daily, age, height, weight, race, incontinence type, etiology of incontinence, history of radiation, smoking, bladder neck contracture, and prostatectomy. Model performance was assessed using area under receiver operating characteristic curve (AUROC), area under precision-recall curve (AUPRC), and F1-score.</p><p><strong>Results: </strong>A total of 181 patients were included in the model. The mean followup was 56.4 months (standard deviation [SD ] 41.6). Slightly more than half (53.6%, 97/181) of patients had procedural success. Logistic regression, K-nearest neighbor (KNN ), naive Bayes, decision tree, and random forest models were developed using ML. KNN model had the best performance, with AUROC of 0.759, AUPRC of 0.916, and F1-score of 0.833. Following ensemble learning with bagging and calibration, KNN model was further improved, with AUROC of 0.821, AUPRC of 0.921, and F-1 score of 0.848.</p><p><strong>Conclusions: </strong>ML-based prediction of long-term transobturator male sling is feasible. The low numbers of patients used to develop the model prompt further validation and development of the model but may serve as a decision-making aid for practitioners in the future.</p>","PeriodicalId":9574,"journal":{"name":"Canadian Urological Association journal = Journal de l'Association des urologues du Canada","volume":" ","pages":"E309-E314"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10581726/pdf/cuaj-10-e309.pdf","citationCount":"0","resultStr":"{\"title\":\"Development and use of machine learning models for prediction of male sling success A proof-of-concept institutional evaluation.\",\"authors\":\"Jin K Kim, Kurt A McCammon, Kellie J Kim, Mandy Rickard, Armando J Lorenzo, Michael E Chua\",\"doi\":\"10.5489/cuaj.8265\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>For mild to moderate male stress urinary incontinence (SUI), transobturator male slings remain an effective option for management. We aimed to use a machine learning (ML )-based model to predict those who will have a long-term success in managing SUI with male sling.</p><p><strong>Methods: </strong>All transobturator male sling cases from August 2006 to June 2012 by a single surgeon were reviewed. Outcome of interest was defined as 'cure': complete dryness with 0 pads used, without the need for additional procedures. Clinical variables included in ML models were: number of pads used daily, age, height, weight, race, incontinence type, etiology of incontinence, history of radiation, smoking, bladder neck contracture, and prostatectomy. Model performance was assessed using area under receiver operating characteristic curve (AUROC), area under precision-recall curve (AUPRC), and F1-score.</p><p><strong>Results: </strong>A total of 181 patients were included in the model. The mean followup was 56.4 months (standard deviation [SD ] 41.6). Slightly more than half (53.6%, 97/181) of patients had procedural success. Logistic regression, K-nearest neighbor (KNN ), naive Bayes, decision tree, and random forest models were developed using ML. KNN model had the best performance, with AUROC of 0.759, AUPRC of 0.916, and F1-score of 0.833. Following ensemble learning with bagging and calibration, KNN model was further improved, with AUROC of 0.821, AUPRC of 0.921, and F-1 score of 0.848.</p><p><strong>Conclusions: </strong>ML-based prediction of long-term transobturator male sling is feasible. The low numbers of patients used to develop the model prompt further validation and development of the model but may serve as a decision-making aid for practitioners in the future.</p>\",\"PeriodicalId\":9574,\"journal\":{\"name\":\"Canadian Urological Association journal = Journal de l'Association des urologues du Canada\",\"volume\":\" \",\"pages\":\"E309-E314\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10581726/pdf/cuaj-10-e309.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Canadian Urological Association journal = Journal de l'Association des urologues du Canada\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5489/cuaj.8265\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Canadian Urological Association journal = Journal de l'Association des urologues du Canada","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5489/cuaj.8265","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Development and use of machine learning models for prediction of male sling success A proof-of-concept institutional evaluation.
Introduction: For mild to moderate male stress urinary incontinence (SUI), transobturator male slings remain an effective option for management. We aimed to use a machine learning (ML )-based model to predict those who will have a long-term success in managing SUI with male sling.
Methods: All transobturator male sling cases from August 2006 to June 2012 by a single surgeon were reviewed. Outcome of interest was defined as 'cure': complete dryness with 0 pads used, without the need for additional procedures. Clinical variables included in ML models were: number of pads used daily, age, height, weight, race, incontinence type, etiology of incontinence, history of radiation, smoking, bladder neck contracture, and prostatectomy. Model performance was assessed using area under receiver operating characteristic curve (AUROC), area under precision-recall curve (AUPRC), and F1-score.
Results: A total of 181 patients were included in the model. The mean followup was 56.4 months (standard deviation [SD ] 41.6). Slightly more than half (53.6%, 97/181) of patients had procedural success. Logistic regression, K-nearest neighbor (KNN ), naive Bayes, decision tree, and random forest models were developed using ML. KNN model had the best performance, with AUROC of 0.759, AUPRC of 0.916, and F1-score of 0.833. Following ensemble learning with bagging and calibration, KNN model was further improved, with AUROC of 0.821, AUPRC of 0.921, and F-1 score of 0.848.
Conclusions: ML-based prediction of long-term transobturator male sling is feasible. The low numbers of patients used to develop the model prompt further validation and development of the model but may serve as a decision-making aid for practitioners in the future.