Development and validation of a mental eHealth literacy scale

IF 4.9 Q1 PSYCHOLOGY, EXPERIMENTAL

Computers in human behavior reports Pub Date : 2024-10-30 DOI:10.1016/j.chbr.2024.100518

Richard Huan Xu , Yuan Cao , Dong Dong , Eliza Lai-yi Wong , Sherry Kit-wa Chan

{"title":"Development and validation of a mental eHealth literacy scale","authors":"Richard Huan Xu , Yuan Cao , Dong Dong , Eliza Lai-yi Wong , Sherry Kit-wa Chan","doi":"10.1016/j.chbr.2024.100518","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>This study aimed to develop a new instrument called the Mental eHealth Literacy Scale (MeHLS) to specifically measure mental eHealth literacy and to assess its psychometric properties in the Chinese population of Hong Kong.</div></div><div><h3>Methods</h3><div>The MeHLS was developed by a mixed-method study design with five phases. Psychometric properties were evaluated using both classical test theory and item response theory (IRT) approaches. For construct validity, we used exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). We assessed convergent validity through hypothesized correlation analysis and known-group validity via ANOVA. We measured internal consistency using Cronbach's Alpha and test-retest reliability using the intraclass correlation coefficient. Receiver Operating Characteristic (ROC) was used to determine the optimal cut-off point of the MeHLS.</div></div><div><h3>Results</h3><div>A total of 2064 individuals completed the survey. Both EFA and CFA demonstrated a three-factor structure of the MeHLS, aligning with the design. The IRT analysis showed the discrimination value ranged between 1.580 and 3.296, with no items having disordered thresholds. Correlation analysis revealed that MeHLS was significantly associated with all concept-related instruments, indicating good convergent validity. ANOVA results demonstrated that MeHLS can significantly differentiate individuals in all risk groups. The MeHLS showed good reliability, with a Cronbach's Alpha of 0.95 and an Intraclass Correlation Coefficient of 0.75. ROC analysis confirmed a cut-off score of 67 to differentiate individuals with high and low MeHL.</div></div><div><h3>Conclusion</h3><div>The MeHLS is a multidimensional instrument that shows good psychometric properties for measuring web-based mental health literacy.</div></div>","PeriodicalId":72681,"journal":{"name":"Computers in human behavior reports","volume":"16 ","pages":"Article 100518"},"PeriodicalIF":4.9000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers in human behavior reports","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2451958824001519","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}

引用次数: 0

Abstract

Objectives

This study aimed to develop a new instrument called the Mental eHealth Literacy Scale (MeHLS) to specifically measure mental eHealth literacy and to assess its psychometric properties in the Chinese population of Hong Kong.

Methods

The MeHLS was developed by a mixed-method study design with five phases. Psychometric properties were evaluated using both classical test theory and item response theory (IRT) approaches. For construct validity, we used exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). We assessed convergent validity through hypothesized correlation analysis and known-group validity via ANOVA. We measured internal consistency using Cronbach's Alpha and test-retest reliability using the intraclass correlation coefficient. Receiver Operating Characteristic (ROC) was used to determine the optimal cut-off point of the MeHLS.

Results

A total of 2064 individuals completed the survey. Both EFA and CFA demonstrated a three-factor structure of the MeHLS, aligning with the design. The IRT analysis showed the discrimination value ranged between 1.580 and 3.296, with no items having disordered thresholds. Correlation analysis revealed that MeHLS was significantly associated with all concept-related instruments, indicating good convergent validity. ANOVA results demonstrated that MeHLS can significantly differentiate individuals in all risk groups. The MeHLS showed good reliability, with a Cronbach's Alpha of 0.95 and an Intraclass Correlation Coefficient of 0.75. ROC analysis confirmed a cut-off score of 67 to differentiate individuals with high and low MeHL.

Conclusion

The MeHLS is a multidimensional instrument that shows good psychometric properties for measuring web-based mental health literacy.

查看原文本刊更多论文

开发和验证心理电子健康素养量表

本研究旨在开发一种名为心理电子健康素养量表（MeHLS）的新工具，以专门测量香港华裔人口的心理电子健康素养，并评估其心理测量学特性。我们采用经典测验理论和项目反应理论（IRT）方法对心理测量特性进行了评估。在构造效度方面，我们采用了探索性因素分析（EFA）和确认性因素分析（CFA）。我们通过假设相关分析评估了收敛效度，并通过方差分析评估了已知组效度。我们使用 Cronbach's Alpha 测量内部一致性，使用类内相关系数测量测试-再测可靠性。接收者操作特征（ROC）用于确定 MeHLS 的最佳截断点。EFA和CFA均显示出MeHLS的三因素结构，与设计相符。IRT分析表明，辨别值介于1.580和3.296之间，没有项目的阈值紊乱。相关性分析表明，MeHLS 与所有概念相关工具都有明显的相关性，表明其具有良好的趋同效度。方差分析结果表明，MeHLS 能明显区分所有风险组别中的个体。MeHLS 显示出良好的可靠性，Cronbach's Alpha 为 0.95，类内相关系数为 0.75。结论MeHLS是一种多维工具，在测量基于网络的心理健康素养方面显示出良好的心理测量特性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Computers in human behavior reports Psychology (General)

CiteScore

7.80

自引率

0.00%

发文量