Test–retest Reliability, Interrater Reliability, and Convergent Validity of the Targeted Box and Block Test in an Upper Extremity Prosthesis User Population

IF 2 Q2 REHABILITATION

Archives of rehabilitation research and clinical translation Pub Date : 2025-09-01 DOI:10.1016/j.arrct.2025.100427

Kimberly Kontson PhD , Bin Wang PhD , Nicole Leung BA , John M. Miguelez CP, FAAOP(D) , Lauren Trent MOT, OTR/L

{"title":"Test–retest Reliability, Interrater Reliability, and Convergent Validity of the Targeted Box and Block Test in an Upper Extremity Prosthesis User Population","authors":"Kimberly Kontson PhD , Bin Wang PhD , Nicole Leung BA , John M. Miguelez CP, FAAOP(D) , Lauren Trent MOT, OTR/L","doi":"10.1016/j.arrct.2025.100427","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>To provide evidence for test–retest reliability, interrater reliability, and convergent validity of the targeted Box and Block Test (tBBT) in the upper limb prosthesis user population.</div></div><div><h3>Design</h3><div>An observational study was designed to assess various psychometric properties of the novel outcome measure. Participants completed the tBBT across 2 distinct testing sessions to assess test–retest reliability, which was quantified using the intraclass correlation coefficient (ICC) (3,k) and Pearson's correlation coefficient. Multiple raters scored the tBBT to assess interrater reliability, which was quantified using the ICC(2,k) and Pearson's correlation coefficient. Convergent validity was assessed by computing the Pearson's correlation coefficient between specific subtasks of the Capacity Assessment of Prosthesis Performance for the Upper Limb (CAPPFUL) and the tBBT.</div></div><div><h3>Setting</h3><div>Clinic.</div></div><div><h3>Participants</h3><div>A convenience sample of 20 transradial, unilateral upper limb prosthesis users.</div></div><div><h3>Interventions</h3><div>Not applicable.</div></div><div><h3>Main Outcome Measures</h3><div>tBBT, Box and Block Test (BBT), and CAPPFUL.</div></div><div><h3>Results</h3><div>Interrater reliability for completion time and identification of unsuccessful transports were found to be excellent for the tBBT with ICC values of 0.97-0.99. Similarly, test–retest reliability was found to be good to excellent with ICC values >0.84. There were strong correlations between the scores obtained by different sessions and the scores given by different raters, with correlation coefficients exceeding 0.75. Moderate to strong correlations were found between the tBBT and BBT and subtasks of the CAPPFUL.</div></div><div><h3>Conclusions</h3><div>The tBBT is a valid and reliable measure to assess the functional performance of individuals using an upper limb prosthetic device. This novel measure offers benefits of ease and speed of implementation; assessment of repetitive, ecologically representative movements; and quantification of performance using both speed and accuracy.</div></div>","PeriodicalId":72291,"journal":{"name":"Archives of rehabilitation research and clinical translation","volume":"7 3","pages":"Article 100427"},"PeriodicalIF":2.0000,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Archives of rehabilitation research and clinical translation","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590109525000023","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"REHABILITATION","Score":null,"Total":0}

引用次数: 0

Abstract

Objective

To provide evidence for test–retest reliability, interrater reliability, and convergent validity of the targeted Box and Block Test (tBBT) in the upper limb prosthesis user population.

Design

An observational study was designed to assess various psychometric properties of the novel outcome measure. Participants completed the tBBT across 2 distinct testing sessions to assess test–retest reliability, which was quantified using the intraclass correlation coefficient (ICC) (3,k) and Pearson's correlation coefficient. Multiple raters scored the tBBT to assess interrater reliability, which was quantified using the ICC(2,k) and Pearson's correlation coefficient. Convergent validity was assessed by computing the Pearson's correlation coefficient between specific subtasks of the Capacity Assessment of Prosthesis Performance for the Upper Limb (CAPPFUL) and the tBBT.

Setting

Clinic.

Participants

A convenience sample of 20 transradial, unilateral upper limb prosthesis users.

Interventions

Not applicable.

Main Outcome Measures

tBBT, Box and Block Test (BBT), and CAPPFUL.

Results

Interrater reliability for completion time and identification of unsuccessful transports were found to be excellent for the tBBT with ICC values of 0.97-0.99. Similarly, test–retest reliability was found to be good to excellent with ICC values >0.84. There were strong correlations between the scores obtained by different sessions and the scores given by different raters, with correlation coefficients exceeding 0.75. Moderate to strong correlations were found between the tBBT and BBT and subtasks of the CAPPFUL.

Conclusions

The tBBT is a valid and reliable measure to assess the functional performance of individuals using an upper limb prosthetic device. This novel measure offers benefits of ease and speed of implementation; assessment of repetitive, ecologically representative movements; and quantification of performance using both speed and accuracy.

查看原文本刊更多论文

上肢义肢使用者群体中目标盒块测试的重测信度、互测信度和收敛效度

目的为目标盒块测验（tBBT）在上肢义肢使用者人群中的重测信度、互测信度和收敛效度提供证据。设计一项观察性研究旨在评估新结果测量的各种心理测量特性。参与者在两个不同的测试阶段完成tBBT，以评估重测信度，使用类内相关系数（ICC）（3,k）和Pearson相关系数对其进行量化。多个评判员对tBBT进行评分，以评估评判员的信度，使用ICC（2,k）和Pearson相关系数对其进行量化。通过计算上肢假肢功能能力评估（CAPPFUL）的特定子任务与tbbt之间的Pearson相关系数来评估聚合效度。设置临床参与者20例经桡骨单侧上肢假肢使用者的方便样本。InterventionsNot适用。主要观察指标：BBT、盒块试验（BBT）和CAPPFUL。结果tBBT在完成时间和不成功转运识别上的信度较好，ICC值为0.97 ~ 0.99。同样地，重新测试的信度在ICC值>；0.84时从良好到优秀。不同时段获得的分数与不同评分者给出的分数之间存在较强的相关性，相关系数均超过0.75。tBBT和BBT与CAPPFUL的子任务之间存在中等到强的相关性。结论tBBT是评估使用上肢假体的个体功能表现的一种有效和可靠的方法。这种新措施提供了易于实施和快速实施的好处；评估重复的、具有生态代表性的运动；使用速度和准确性对性能进行量化。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊