Development and validation of an instrument to assess the perception of competencies and level of preparedness in telehealth.

IF 1.2 Q2 MEDICINE, GENERAL & INTERNAL

Medwave Pub Date : 2025-05-09 DOI:10.5867/medwave.2025.04.3032

Jacqueline Ibarra-Peso, Marcela Hechenleitner-Carvallo

{"title":"Development and validation of an instrument to assess the perception of competencies and level of preparedness in telehealth.","authors":"Jacqueline Ibarra-Peso, Marcela Hechenleitner-Carvallo","doi":"10.5867/medwave.2025.04.3032","DOIUrl":null,"url":null,"abstract":"Introduction: There is a need for a validated instrument that assesses the perception of competencies and the level of preparedness of professionals and technicians who perform telehealth care in Chile.Objective: To develop and evaluate the reliability and validity of an instrument designed to measure the perception of competencies and the level of preparedness in telehealth.Methods: An instrument on telehealth competencies and level of preparedness was designed, obtaining content validity through expert judgement. The instrument was then administered in 2023 to a total of 83 healthcare professionals and technicians with telehealth experience. To determine construct validity, exploratory factor analysis was conducted, extracting factors using Principal Axes and estimating the number of factors by combining Horn's Parallel Analysis and scree plot. Rotation was performed using the Oblimin method. To estimate reliability, Cronbach's Alpha statistic was calculated.Results: The factor analysis identified items with loadings over 0.6, resulting in a final scale of two factors with a total of 31 items. This factorial model explained 75.5% of the total variance. The first factor brings together items assessing perceptions of telehealth competencies, and the second factor assesses perceptions of the level of telehealth preparedness. Both factors show adequate reliability indicators, with Cronbach's Alpha of 0.98 and 0.97 respectively, and present correlations considered adequate.Conclusions: The instrument has adequate psychometric indicators, even considering the sample size, to measure the perception of competencies and level of preparation in telehealth in health professionals and technicians in the Biobío region. The two factors that make up the instrument help identify training and education needs. It is suggested to extend the validation to samples from other regions and to increase the diversity of clinical disciplines.","PeriodicalId":18597,"journal":{"name":"Medwave","volume":"25 4","pages":"e3032"},"PeriodicalIF":1.2000,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medwave","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5867/medwave.2025.04.3032","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction: There is a need for a validated instrument that assesses the perception of competencies and the level of preparedness of professionals and technicians who perform telehealth care in Chile.

Objective: To develop and evaluate the reliability and validity of an instrument designed to measure the perception of competencies and the level of preparedness in telehealth.

Methods: An instrument on telehealth competencies and level of preparedness was designed, obtaining content validity through expert judgement. The instrument was then administered in 2023 to a total of 83 healthcare professionals and technicians with telehealth experience. To determine construct validity, exploratory factor analysis was conducted, extracting factors using Principal Axes and estimating the number of factors by combining Horn's Parallel Analysis and scree plot. Rotation was performed using the Oblimin method. To estimate reliability, Cronbach's Alpha statistic was calculated.

Results: The factor analysis identified items with loadings over 0.6, resulting in a final scale of two factors with a total of 31 items. This factorial model explained 75.5% of the total variance. The first factor brings together items assessing perceptions of telehealth competencies, and the second factor assesses perceptions of the level of telehealth preparedness. Both factors show adequate reliability indicators, with Cronbach's Alpha of 0.98 and 0.97 respectively, and present correlations considered adequate.

Conclusions: The instrument has adequate psychometric indicators, even considering the sample size, to measure the perception of competencies and level of preparation in telehealth in health professionals and technicians in the Biobío region. The two factors that make up the instrument help identify training and education needs. It is suggested to extend the validation to samples from other regions and to increase the diversity of clinical disciplines.

查看原文本刊更多论文

开发和验证一种工具，以评估对远程保健的能力和准备水平的认识。

导言：需要一种有效的工具来评估智利从事远程保健的专业人员和技术人员的能力认知和准备水平。目标：开发和评估一种旨在衡量远程保健能力认知和准备水平的工具的可靠性和有效性。方法：设计一套远程医疗能力与准备水平量表，通过专家判断获得内容效度。然后，在2023年，共有83名具有远程医疗经验的医疗保健专业人员和技术人员使用了该仪器。为确定结构效度，进行探索性因子分析，利用主轴提取因子，结合Horn’s Parallel analysis和screen plot估计因子数量。采用Oblimin法进行旋转。为了估计信度，计算Cronbach's Alpha统计量。结果：因子分析识别出负荷量大于0.6的项目，最终得到两个因素共31个项目的量表。该析因模型解释了总方差的75.5%。第一个因素汇集了评估对远程保健能力的看法的项目，第二个因素评估了对远程保健准备水平的看法。这两个因素的信度指标都足够，Cronbach’s Alpha分别为0.98和0.97，相关性被认为是足够的。结论：即使考虑到样本量，该工具也有足够的心理测量指标来衡量Biobío区域卫生专业人员和技术人员对远程保健的能力和准备水平的看法。构成该工具的两个因素有助于确定培训和教育需求。建议将验证扩展到其他地区的样本，并增加临床学科的多样性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Medwave MEDICINE, GENERAL & INTERNAL-

CiteScore

2.60

自引率

8.30%

发文量

审稿时长

12 weeks

期刊介绍： Medwave is a peer-reviewed, biomedical and public health journal. Since its foundation in 2001 (Volume 1) it has always been an online only, open access publication that does not charge subscription or reader fees. Since January 2011 (Volume 11, Number 1), all articles are peer-reviewed. Without losing sight of the importance of evidence-based approach and methodological soundness, the journal accepts for publication articles that focus on providing updates for clinical practice, review and analysis articles on topics such as ethics, public health and health policy; clinical, social and economic health determinants; clinical and health research findings from all of the major disciplines of medicine, medical science and public health. The journal does not publish basic science manuscripts or experiments conducted on animals. Until March 2013, Medwave was publishing 11-12 numbers a year. Each issue would be posted on the homepage on day 1 of each month, except for Chile’s summer holiday when the issue would cover two months. Starting from April 2013, Medwave adopted the continuous mode of publication, which means that the copyedited accepted articles are posted on the journal’s homepage as they are ready. They are then collated in the respective issue and included in the Past Issues section.