Zhehan Jiang, Hao Hang, Xinyu Wu, Shate Xiang, Shucheng Pan
{"title":"结合转移有效性和变化点分析的模拟训练成本效益评估方法创新。","authors":"Zhehan Jiang, Hao Hang, Xinyu Wu, Shate Xiang, Shucheng Pan","doi":"10.1177/23821205251368247","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Simulation-based medical education has become increasingly prevalent. However, the high cost and lack of comprehensive effectiveness evaluations have raised questions about its feasibility. This study introduces a novel approach to assess the cost-effectiveness of simulation training.</p><p><strong>Methods: </strong>This study uses simulated data from 120 medical students, set in a teaching hospital scenario, and randomly assigns them to 6 groups with different training durations. This was done to determine the optimal length of VR training that maximizes knowledge and skills transfer efficiency while minimizing costs, using 4 analytical methods: the transfer effectiveness ratio (TER) quantifying time savings, the incremental TER (ITER) assessing individual gains, isoperformance curves mapping cost-effectiveness, and change-point analysis identifying diminishing returns.</p><p><strong>Results: </strong>The overall TER of 0.66 indicates 0.66 units of time saved per simulation training unit invested; peak ITER variability occurred in the 3h cohort, reflecting divergent individual responses to incremental training; isoperformance curves established a 4.5min minimum operative time threshold, defining inherent procedural constraints; and an inflection point at 8 VR training hours (80th data point) marked the onset of diminishing returns.</p><p><strong>Conclusions: </strong>The methodological innovation of integrating TER, ITER, isoperformance curves, and change-point analysis offers a new framework for evaluating the cost-effectiveness of simulation training in medical education. The findings highlight the potential for simulation training to reduce the time required to achieve clinical competency and to optimize training strategies.</p>","PeriodicalId":45121,"journal":{"name":"Journal of Medical Education and Curricular Development","volume":"12 ","pages":"23821205251368247"},"PeriodicalIF":1.6000,"publicationDate":"2025-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12344240/pdf/","citationCount":"0","resultStr":"{\"title\":\"Methodological Innovation in Evaluating the Cost-Effectiveness of Simulation Training Combining Transfer Effectiveness and Change-Point Analysis.\",\"authors\":\"Zhehan Jiang, Hao Hang, Xinyu Wu, Shate Xiang, Shucheng Pan\",\"doi\":\"10.1177/23821205251368247\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Simulation-based medical education has become increasingly prevalent. However, the high cost and lack of comprehensive effectiveness evaluations have raised questions about its feasibility. This study introduces a novel approach to assess the cost-effectiveness of simulation training.</p><p><strong>Methods: </strong>This study uses simulated data from 120 medical students, set in a teaching hospital scenario, and randomly assigns them to 6 groups with different training durations. This was done to determine the optimal length of VR training that maximizes knowledge and skills transfer efficiency while minimizing costs, using 4 analytical methods: the transfer effectiveness ratio (TER) quantifying time savings, the incremental TER (ITER) assessing individual gains, isoperformance curves mapping cost-effectiveness, and change-point analysis identifying diminishing returns.</p><p><strong>Results: </strong>The overall TER of 0.66 indicates 0.66 units of time saved per simulation training unit invested; peak ITER variability occurred in the 3h cohort, reflecting divergent individual responses to incremental training; isoperformance curves established a 4.5min minimum operative time threshold, defining inherent procedural constraints; and an inflection point at 8 VR training hours (80th data point) marked the onset of diminishing returns.</p><p><strong>Conclusions: </strong>The methodological innovation of integrating TER, ITER, isoperformance curves, and change-point analysis offers a new framework for evaluating the cost-effectiveness of simulation training in medical education. The findings highlight the potential for simulation training to reduce the time required to achieve clinical competency and to optimize training strategies.</p>\",\"PeriodicalId\":45121,\"journal\":{\"name\":\"Journal of Medical Education and Curricular Development\",\"volume\":\"12 \",\"pages\":\"23821205251368247\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2025-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12344240/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Medical Education and Curricular Development\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/23821205251368247\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Education and Curricular Development","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/23821205251368247","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
Methodological Innovation in Evaluating the Cost-Effectiveness of Simulation Training Combining Transfer Effectiveness and Change-Point Analysis.
Background: Simulation-based medical education has become increasingly prevalent. However, the high cost and lack of comprehensive effectiveness evaluations have raised questions about its feasibility. This study introduces a novel approach to assess the cost-effectiveness of simulation training.
Methods: This study uses simulated data from 120 medical students, set in a teaching hospital scenario, and randomly assigns them to 6 groups with different training durations. This was done to determine the optimal length of VR training that maximizes knowledge and skills transfer efficiency while minimizing costs, using 4 analytical methods: the transfer effectiveness ratio (TER) quantifying time savings, the incremental TER (ITER) assessing individual gains, isoperformance curves mapping cost-effectiveness, and change-point analysis identifying diminishing returns.
Results: The overall TER of 0.66 indicates 0.66 units of time saved per simulation training unit invested; peak ITER variability occurred in the 3h cohort, reflecting divergent individual responses to incremental training; isoperformance curves established a 4.5min minimum operative time threshold, defining inherent procedural constraints; and an inflection point at 8 VR training hours (80th data point) marked the onset of diminishing returns.
Conclusions: The methodological innovation of integrating TER, ITER, isoperformance curves, and change-point analysis offers a new framework for evaluating the cost-effectiveness of simulation training in medical education. The findings highlight the potential for simulation training to reduce the time required to achieve clinical competency and to optimize training strategies.