Developing an AI-Based clinical decision support system for basal insulin titration in type 2 diabetes in primary Care: A Mixed-Methods evaluation using heuristic Analysis, user Feedback, and eye tracking
IF 3.7 2区 医学Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Camilla Heisel Nyholm Thomsen , Thomas Kronborg , Stine Hangaard , Peter Vestergaard , Morten Hasselstrøm Jensen
{"title":"Developing an AI-Based clinical decision support system for basal insulin titration in type 2 diabetes in primary Care: A Mixed-Methods evaluation using heuristic Analysis, user Feedback, and eye tracking","authors":"Camilla Heisel Nyholm Thomsen , Thomas Kronborg , Stine Hangaard , Peter Vestergaard , Morten Hasselstrøm Jensen","doi":"10.1016/j.ijmedinf.2024.105783","DOIUrl":null,"url":null,"abstract":"<div><h3>Background and aim</h3><div>The progressive nature of type 2 diabetes often, in time, necessitates basal insulin therapy to achieve glycemic targets. However, despite standardized titration algorithms, many people remain poorly controlled after initiating insulin therapy, leading to suboptimal glycemic control and complications. Both healthcare professionals and people with type 2 diabetes have expressed the need for novel tools to aid in this process. Traditional titration methods often lack the precision needed to address individual differences in glycemic response. Recent studies have highlighted the potential of AI-driven solutions, which can leverage large datasets to model patient-specific characteristics. Therefore, this study aims to develop a digital platform for an AI-based clinical decision support system to assist healthcare professionals in primary care with personalized and optimal basal insulin titration for people with type 2 diabetes.</div></div><div><h3>Methods</h3><div>An iterative mixed-method approach was used for system development, incorporating usability engineering principles. Initial requirements were gathered from domain experts and followed by heuristic evaluation and user-based evaluation. Data from these evaluations guided successive iterations of the prototype.</div></div><div><h3>Results</h3><div>The initial prototype featured a retrospective graph of insulin doses and fasting glucose levels and a dose adjustment simulation environment. Heuristic evaluation identified 92 issues, primarily related to minimalistic and aesthetic design. The second prototype addressed these concerns, but user-based evaluation found 66 additional usability problems, notably with HbA1c presentation and the need for more glucose measures. The final prototype showed high usability, with a median System Usability Scale score of 93.8. Task completion rates were high (task 1: 87.5%, task 2: 75.0%, and task 3: 100%). Eye-tracking data showed minimal distractions.</div></div><div><h3>Conclusions</h3><div>The AI-based Clinical Decision Support System shows promise in managing basal insulin titration for people with type 2 diabetes, addressing clinical inertia, and providing a user-friendly, efficient tool to improve glycemic control during insulin titration.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"195 ","pages":"Article 105783"},"PeriodicalIF":3.7000,"publicationDate":"2024-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386505624004465","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Background and aim
The progressive nature of type 2 diabetes often, in time, necessitates basal insulin therapy to achieve glycemic targets. However, despite standardized titration algorithms, many people remain poorly controlled after initiating insulin therapy, leading to suboptimal glycemic control and complications. Both healthcare professionals and people with type 2 diabetes have expressed the need for novel tools to aid in this process. Traditional titration methods often lack the precision needed to address individual differences in glycemic response. Recent studies have highlighted the potential of AI-driven solutions, which can leverage large datasets to model patient-specific characteristics. Therefore, this study aims to develop a digital platform for an AI-based clinical decision support system to assist healthcare professionals in primary care with personalized and optimal basal insulin titration for people with type 2 diabetes.
Methods
An iterative mixed-method approach was used for system development, incorporating usability engineering principles. Initial requirements were gathered from domain experts and followed by heuristic evaluation and user-based evaluation. Data from these evaluations guided successive iterations of the prototype.
Results
The initial prototype featured a retrospective graph of insulin doses and fasting glucose levels and a dose adjustment simulation environment. Heuristic evaluation identified 92 issues, primarily related to minimalistic and aesthetic design. The second prototype addressed these concerns, but user-based evaluation found 66 additional usability problems, notably with HbA1c presentation and the need for more glucose measures. The final prototype showed high usability, with a median System Usability Scale score of 93.8. Task completion rates were high (task 1: 87.5%, task 2: 75.0%, and task 3: 100%). Eye-tracking data showed minimal distractions.
Conclusions
The AI-based Clinical Decision Support System shows promise in managing basal insulin titration for people with type 2 diabetes, addressing clinical inertia, and providing a user-friendly, efficient tool to improve glycemic control during insulin titration.
期刊介绍:
International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings.
The scope of journal covers:
Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.;
Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc.
Educational computer based programs pertaining to medical informatics or medicine in general;
Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.