Usability and effectiveness of a telehealth artificial-intelligence powered platform: perspectives from patients and providers in a mixed-methods study.
Ekta Jain, Srishti Gupta, Vandana Yadav, Stan Kachnowski
{"title":"Usability and effectiveness of a telehealth artificial-intelligence powered platform: perspectives from patients and providers in a mixed-methods study.","authors":"Ekta Jain, Srishti Gupta, Vandana Yadav, Stan Kachnowski","doi":"10.2196/62742","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Telemedicine has revolutionized healthcare by significantly enhancing accessibility. However, the acceptability and uptake of tele-medicine is prone to various hindering factors. Studies have shown that both patients and healthcare providers appreciate the aspect of convenience. However, healthcare providers' limited understanding of or inability to leverage the technology involved can be a barrier. With advancements in telemedicine technologies, understanding the viewpoints of patients and providers is crucial for an effective and acceptable telemedicine service. This study reports findings from a usability study of HelixVM™, a telemedicine platform that uses an Artificial Intelligence (AI)-powered triage for healthcare delivery. We discuss aspects of asynchronous medicine, healthcare accessibility, saving time, productivity, data exchange, security, privacy, AI-powered triage and quality of care.</p><p><strong>Objective: </strong>To assess the usability and effectiveness of the HelixVM marketplace platform.</p><p><strong>Methods: </strong>We recruited 102 patients and 12 providers in a mixed-methods study design involving surveys, and in-depth structured interviews with a subset of the providers only. The survey questionnaires are a modified version of the telehealth utility questionnaire. We analyzed the patient's data using descriptive statistics and factor analysis to identify latent demographic patterns. For the providers data, we used a deductive thematic analysis approach to identify key themes from the interviews and interpreted overall sentiments of the providers for negative, neutral or positive. We also calculated percentages of different responses for the providers from the surveys and interviews, where applicable.</p><p><strong>Results: </strong>Patients: Overall, 86% of patients are satisfied with HelixVM and 89% will use the services again. More than 90% of patients agreed that HelixVM improves access to healthcare, saves time and that the platform is an acceptable way to receive healthcare. Chi-square tests demonstrate statistical significance for all the survey questions (p-value <.001). Results from factor analysis show a higher propensity of female gender in middle age groups whose encounter type is fast-track, self-report medium level of tech-savviness and residing in the South regions of US rate the platform more positively. Providers: Thematic analysis identified themes of asynchronous medicine in terms of accessibility and quality of care, time and productivity, integration within the workflow, data exchange and AI-triage. Certain challenges of incomplete data in patient chart and its impact on provider time are cited. Suggestions for improvements include options to ensure completeness of patient questionnaires and better screening to ensure that only asynchronous 'qualified' patients get through to the provider.</p><p><strong>Conclusions: </strong>Overall, our study findings indicate a positive experience for patients and providers. The use of fast-track prescription is favorable as compared to traditional telemedicine. Some concerns on data completeness, gaps and accuracy exist. Suggestions are provided for improvement. This study adds to the knowledgebase of existing literature and provides for a detailed analysis into the real-world implementation of a telemedicine market-place platform.</p><p><strong>Clinicaltrial: </strong></p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Formative Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/62742","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Telemedicine has revolutionized healthcare by significantly enhancing accessibility. However, the acceptability and uptake of tele-medicine is prone to various hindering factors. Studies have shown that both patients and healthcare providers appreciate the aspect of convenience. However, healthcare providers' limited understanding of or inability to leverage the technology involved can be a barrier. With advancements in telemedicine technologies, understanding the viewpoints of patients and providers is crucial for an effective and acceptable telemedicine service. This study reports findings from a usability study of HelixVM™, a telemedicine platform that uses an Artificial Intelligence (AI)-powered triage for healthcare delivery. We discuss aspects of asynchronous medicine, healthcare accessibility, saving time, productivity, data exchange, security, privacy, AI-powered triage and quality of care.
Objective: To assess the usability and effectiveness of the HelixVM marketplace platform.
Methods: We recruited 102 patients and 12 providers in a mixed-methods study design involving surveys, and in-depth structured interviews with a subset of the providers only. The survey questionnaires are a modified version of the telehealth utility questionnaire. We analyzed the patient's data using descriptive statistics and factor analysis to identify latent demographic patterns. For the providers data, we used a deductive thematic analysis approach to identify key themes from the interviews and interpreted overall sentiments of the providers for negative, neutral or positive. We also calculated percentages of different responses for the providers from the surveys and interviews, where applicable.
Results: Patients: Overall, 86% of patients are satisfied with HelixVM and 89% will use the services again. More than 90% of patients agreed that HelixVM improves access to healthcare, saves time and that the platform is an acceptable way to receive healthcare. Chi-square tests demonstrate statistical significance for all the survey questions (p-value <.001). Results from factor analysis show a higher propensity of female gender in middle age groups whose encounter type is fast-track, self-report medium level of tech-savviness and residing in the South regions of US rate the platform more positively. Providers: Thematic analysis identified themes of asynchronous medicine in terms of accessibility and quality of care, time and productivity, integration within the workflow, data exchange and AI-triage. Certain challenges of incomplete data in patient chart and its impact on provider time are cited. Suggestions for improvements include options to ensure completeness of patient questionnaires and better screening to ensure that only asynchronous 'qualified' patients get through to the provider.
Conclusions: Overall, our study findings indicate a positive experience for patients and providers. The use of fast-track prescription is favorable as compared to traditional telemedicine. Some concerns on data completeness, gaps and accuracy exist. Suggestions are provided for improvement. This study adds to the knowledgebase of existing literature and provides for a detailed analysis into the real-world implementation of a telemedicine market-place platform.