Psychometric properties of computerized adaptive testing for chronic obstructive pulmonary disease patient-reported outcome measurement.

IF 3.2 2区医学 Q1 HEALTH CARE SCIENCES & SERVICES

Health and Quality of Life Outcomes Pub Date : 2024-09-04 DOI:10.1186/s12955-024-02291-6

Jiajia Wang, Yang Xie, Zhenzhen Feng, Jiansheng Li

{"title":"Psychometric properties of computerized adaptive testing for chronic obstructive pulmonary disease patient-reported outcome measurement.","authors":"Jiajia Wang, Yang Xie, Zhenzhen Feng, Jiansheng Li","doi":"10.1186/s12955-024-02291-6","DOIUrl":null,"url":null,"abstract":"Background: Computerized adaptive testing (CAT) is an effective way to reduce time, repetitious redundancy, and respond burden, and has been used to measure outcomes in many diseases. This study aimed to develop and validate a comprehensive disease-specific CAT for chronic obstructive pulmonary disease (COPD) patient-reported outcome measurement.Methods: The discrimination and difficulty of the items from the modified patient-reported outcome scale for COPD (mCOPD-PRO) were analyzed using item response theory. Then the initial item, item selection method, ability estimation method, and stopping criteria were further set based on Concerto platform to form the CAT. Finally, the reliability and validity were validated.Results: The item discrimination ranged from 1.05 to 2.71, and the item difficulty ranged from - 3.08 to 3.65. The measurement reliability of the CAT ranged from 0.910 to 0.922 using random method, while that ranged from 0.910 to 0.924 using maximum Fisher information (MFI) method. The content validity was good. The correlation coefficient between theta of the CAT and COPD assessment test and modified Medical Research Council dyspnea scale scores using random method was 0.628 and 0.540 (P < 0.001; P < 0.001) respectively, while that using MFI method was 0.347 and 0.328 (P = 0.007; P = 0.010) respectively. About 11 items (reducing by 59.3%) on average were tested using random method, while about seven items (reducing by 74.1%) on average using MFI method. The correlation coefficient between theta of the CAT and mCOPD-PRO total scores using random method was 0.919 (P < 0.001), while that using MFI method was 0.760 (P < 0.001).Conclusions: The comprehensive disease-specific CAT for COPD patient-reported outcome measurement is well developed with good psychometric properties, which can provide an efficient, accurate, and user-friendly measurement for patient-reported outcome of COPD.","PeriodicalId":12980,"journal":{"name":"Health and Quality of Life Outcomes","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11373186/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health and Quality of Life Outcomes","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12955-024-02291-6","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}

引用次数: 0

Abstract

Background: Computerized adaptive testing (CAT) is an effective way to reduce time, repetitious redundancy, and respond burden, and has been used to measure outcomes in many diseases. This study aimed to develop and validate a comprehensive disease-specific CAT for chronic obstructive pulmonary disease (COPD) patient-reported outcome measurement.

Methods: The discrimination and difficulty of the items from the modified patient-reported outcome scale for COPD (mCOPD-PRO) were analyzed using item response theory. Then the initial item, item selection method, ability estimation method, and stopping criteria were further set based on Concerto platform to form the CAT. Finally, the reliability and validity were validated.

Results: The item discrimination ranged from 1.05 to 2.71, and the item difficulty ranged from - 3.08 to 3.65. The measurement reliability of the CAT ranged from 0.910 to 0.922 using random method, while that ranged from 0.910 to 0.924 using maximum Fisher information (MFI) method. The content validity was good. The correlation coefficient between theta of the CAT and COPD assessment test and modified Medical Research Council dyspnea scale scores using random method was 0.628 and 0.540 (P < 0.001; P < 0.001) respectively, while that using MFI method was 0.347 and 0.328 (P = 0.007; P = 0.010) respectively. About 11 items (reducing by 59.3%) on average were tested using random method, while about seven items (reducing by 74.1%) on average using MFI method. The correlation coefficient between theta of the CAT and mCOPD-PRO total scores using random method was 0.919 (P < 0.001), while that using MFI method was 0.760 (P < 0.001).

Conclusions: The comprehensive disease-specific CAT for COPD patient-reported outcome measurement is well developed with good psychometric properties, which can provide an efficient, accurate, and user-friendly measurement for patient-reported outcome of COPD.

查看原文本刊更多论文

用于慢性阻塞性肺病患者报告结果测量的计算机自适应测试的心理计量特性。

背景：计算机化自适应测试（CAT）是减少时间、重复冗余和应答负担的有效方法，已被用于测量许多疾病的结果。本研究旨在开发和验证用于慢性阻塞性肺病（COPD）患者报告结果测量的综合疾病特异性计算机适应性测试：方法：采用项目反应理论分析了改良的慢性阻塞性肺疾病（COPD）患者报告结果量表（mCOPD-PRO）中项目的区分度和难度。然后基于 Concerto 平台进一步设定初始项目、项目选择方法、能力估计方法和终止标准，形成 CAT。最后，对信度和效度进行了验证：项目区分度在 1.05 到 2.71 之间，项目难度在-3.08 到 3.65 之间。采用随机法，CAT 的测量信度在 0.910 至 0.922 之间；采用最大费舍尔信息法（MFI），CAT 的测量信度在 0.910 至 0.924 之间。内容效度良好。采用随机法时，CAT 与慢性阻塞性肺病评估测试和改良医学研究委员会呼吸困难量表评分之间的相关系数分别为 0.628 和 0.540（P 结论：CAT 与慢性阻塞性肺病评估测试和改良医学研究委员会呼吸困难量表评分之间的相关系数分别为 0.628 和 0.540：用于慢性阻塞性肺病患者报告结果测量的疾病特异性综合 CAT 具有良好的心理测量学特性，可为慢性阻塞性肺病患者报告结果测量提供高效、准确和易于使用的方法。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Health and Quality of Life Outcomes 医学-卫生保健

CiteScore

7.30

自引率

2.80%

发文量

154

审稿时长

3-8 weeks

期刊介绍： Health and Quality of Life Outcomes is an open access, peer-reviewed, journal offering high quality articles, rapid publication and wide diffusion in the public domain. Health and Quality of Life Outcomes considers original manuscripts on the Health-Related Quality of Life (HRQOL) assessment for evaluation of medical and psychosocial interventions. It also considers approaches and studies on psychometric properties of HRQOL and patient reported outcome measures, including cultural validation of instruments if they provide information about the impact of interventions. The journal publishes study protocols and reviews summarising the present state of knowledge concerning a particular aspect of HRQOL and patient reported outcome measures. Reviews should generally follow systematic review methodology. Comments on articles and letters to the editor are welcome.