User experience study to evaluate a clinical decision support system prototype supporting continuous kidney replacement therapy in a simulated ICU environment.
L-M Kunz, M Metzger, C Schaefer, R Pohlmeier, J Petrovic Vorkapic, Michael Nosch
{"title":"User experience study to evaluate a clinical decision support system prototype supporting continuous kidney replacement therapy in a simulated ICU environment.","authors":"L-M Kunz, M Metzger, C Schaefer, R Pohlmeier, J Petrovic Vorkapic, Michael Nosch","doi":"10.1186/s12911-025-03165-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The increasing amount of data routinely collected on ICUs poses a challenge for clinicians which is aggravated with data-heavy therapies like Continuous Kidney Replacement Therapy (CKRT). We developed the CKRT Supporting Software Prototype (CKRT-SSP), a clinical decision support system for use before, during and after CKRT. The aim of this user experience (UX) study was to prospectively evaluate CKRT-SSP in terms of usability, user experience, and workload in a simulated ICU setting.</p><p><strong>Methods: </strong>We simulated CKRT treatments in a fully equipped single patient room in the ICU and evaluated CKRT-SSP using validated questionnaires: System Usability Scale (SUS) and User Experience Questionnaire (UEQ). Furthermore, a modified NASA-TLX (task load index) compared the workload before and after using CKRT-SSP. Twelve clinicians and nurses participated in this study.</p><p><strong>Results: </strong>The SUS reached a median value of 87.5 for CKRT-SSP, reflecting excellent usability. In the UEQ, CKRT-SSP scored clearly positive in the attractiveness dimension and the three task-related dimensions of clarity, efficiency, and dependability (95% CI fully > 0.8). For the two non-task-related dimensions, stimulation and novelty, there was a positive trend (mean > 0.8, lower limit of 95% CI < 0.8). The modified NASA-TLX suggests a trend to less total workload with CKRT-SSP which mainly is attributable to less physical demand and less effort.</p><p><strong>Conclusion: </strong>CKRT-SSP is a promising tool for improving the workload in ICUs and the specific application of CKRT. We obtained valuable insights for further user-centric development.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"25 1","pages":"328"},"PeriodicalIF":3.8000,"publicationDate":"2025-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12424209/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Informatics and Decision Making","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12911-025-03165-7","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The increasing amount of data routinely collected on ICUs poses a challenge for clinicians which is aggravated with data-heavy therapies like Continuous Kidney Replacement Therapy (CKRT). We developed the CKRT Supporting Software Prototype (CKRT-SSP), a clinical decision support system for use before, during and after CKRT. The aim of this user experience (UX) study was to prospectively evaluate CKRT-SSP in terms of usability, user experience, and workload in a simulated ICU setting.
Methods: We simulated CKRT treatments in a fully equipped single patient room in the ICU and evaluated CKRT-SSP using validated questionnaires: System Usability Scale (SUS) and User Experience Questionnaire (UEQ). Furthermore, a modified NASA-TLX (task load index) compared the workload before and after using CKRT-SSP. Twelve clinicians and nurses participated in this study.
Results: The SUS reached a median value of 87.5 for CKRT-SSP, reflecting excellent usability. In the UEQ, CKRT-SSP scored clearly positive in the attractiveness dimension and the three task-related dimensions of clarity, efficiency, and dependability (95% CI fully > 0.8). For the two non-task-related dimensions, stimulation and novelty, there was a positive trend (mean > 0.8, lower limit of 95% CI < 0.8). The modified NASA-TLX suggests a trend to less total workload with CKRT-SSP which mainly is attributable to less physical demand and less effort.
Conclusion: CKRT-SSP is a promising tool for improving the workload in ICUs and the specific application of CKRT. We obtained valuable insights for further user-centric development.
期刊介绍：
BMC Medical Informatics and Decision Making is an open access journal publishing original peer-reviewed research articles in relation to the design, development, implementation, use, and evaluation of health information technologies and decision-making for human health.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
