Mary Vining Radomski, Ginger Carroll, Leslie Davidson, Aaron Eakman, Kristina Kath, Rob Kreiger, Amy Meyers, Stacey Rabusch, Laurel Smith, Chris Tripp, Timothy Wolf
{"title":"开发和评估维修办公室值班测试:用于评估轻度脑外伤后执行功能的 \"负责宿舍值班测试 \"的替代形式,为脑震荡后的值班准备提供信息。","authors":"Mary Vining Radomski, Ginger Carroll, Leslie Davidson, Aaron Eakman, Kristina Kath, Rob Kreiger, Amy Meyers, Stacey Rabusch, Laurel Smith, Chris Tripp, Timothy Wolf","doi":"10.1093/milmed/usae391","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>After mild traumatic brain injury, service members may experience difficulty with executive functions, which could interfere with return to duty and life roles. Because performance-based multitasking assessments are sensitive to executive dysfunction, a team of military and civilian rehabilitation researchers developed the Charge of Quarters Duty Test (CQDT) to help inform duty readiness after concussion; it is a multitasking test based on a military task scenario that challenges executive functions, such as foresight and planning, set shifting, and prospective memory. Although previous study indicates that CQDT has reliability and known-groups validity, like other multitasking tests, it should not be readministered after rehabilitative care because of learning effects. The purpose of this study was to develop an alternate form of the CQDT and evaluate its equivalence to the CQDT.</p><p><strong>Materials and methods: </strong>A measurement development study was conducted in which subject matter experts on the study team used an iterative approach to create an alternate form. To evaluate equivalence, a repeated measures design was employed in which each participant performed one or both test versions twice and acted as their own control.</p><p><strong>Results: </strong>The study team created the Maintenance Office Duty Test (MODT), the alternate form of the CQDT. A convenience sample of 40 adults performed both the MODT and CQDT approximately 2 weeks apart; 4 had a history of military service and 16 had a history of acquired brain injury. We compared mean scores and standard deviations of each test's 4 subscores using matched-pair t-tests and found that scores were not statistically different, suggesting that the 2 tests are equivalent. In addition, matched-pair t-tests were used to compare Time 1 and Time 2 subscores when (1) participants performed the 2 test versions (CQDT and MODT) and (2) participants performed the same test twice. None of the differences in Time 1 and Time 2 subscores were statistically significant when participants performed the 2 test versions. However, when participants performed the same test twice, three of the four Time 1 and Time 2 scores were significantly different, with Time 2 reflecting improved performance and possible learning effects (performance accuracy P = .013; total number of rule breaks P = .015; performance time P = .002).</p><p><strong>Conclusions: </strong>The MODT appears to be an equivalent form of the CQDT that mitigates learning effects that often accompany performance of multitasking assessments. Having developed and validated the equivalence of the CDQT's alternate form, military rehabilitation clinicians have an expanded set of clinical tools by which to identify possible executive dysfunction and evaluate service members' response to rehabilitative care via pre- and post-rehabilitation testing after mild traumatic brain injury.</p>","PeriodicalId":18638,"journal":{"name":"Military Medicine","volume":" ","pages":"601-608"},"PeriodicalIF":1.2000,"publicationDate":"2025-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and Evaluation of the Maintenance Office Duty Test: An Alternate Form of the Charge of Quarters Duty Test for Assessing Executive Function After Mild Traumatic Brain Injury to Inform Duty-Readiness After Concussion.\",\"authors\":\"Mary Vining Radomski, Ginger Carroll, Leslie Davidson, Aaron Eakman, Kristina Kath, Rob Kreiger, Amy Meyers, Stacey Rabusch, Laurel Smith, Chris Tripp, Timothy Wolf\",\"doi\":\"10.1093/milmed/usae391\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>After mild traumatic brain injury, service members may experience difficulty with executive functions, which could interfere with return to duty and life roles. Because performance-based multitasking assessments are sensitive to executive dysfunction, a team of military and civilian rehabilitation researchers developed the Charge of Quarters Duty Test (CQDT) to help inform duty readiness after concussion; it is a multitasking test based on a military task scenario that challenges executive functions, such as foresight and planning, set shifting, and prospective memory. Although previous study indicates that CQDT has reliability and known-groups validity, like other multitasking tests, it should not be readministered after rehabilitative care because of learning effects. The purpose of this study was to develop an alternate form of the CQDT and evaluate its equivalence to the CQDT.</p><p><strong>Materials and methods: </strong>A measurement development study was conducted in which subject matter experts on the study team used an iterative approach to create an alternate form. To evaluate equivalence, a repeated measures design was employed in which each participant performed one or both test versions twice and acted as their own control.</p><p><strong>Results: </strong>The study team created the Maintenance Office Duty Test (MODT), the alternate form of the CQDT. A convenience sample of 40 adults performed both the MODT and CQDT approximately 2 weeks apart; 4 had a history of military service and 16 had a history of acquired brain injury. We compared mean scores and standard deviations of each test's 4 subscores using matched-pair t-tests and found that scores were not statistically different, suggesting that the 2 tests are equivalent. In addition, matched-pair t-tests were used to compare Time 1 and Time 2 subscores when (1) participants performed the 2 test versions (CQDT and MODT) and (2) participants performed the same test twice. None of the differences in Time 1 and Time 2 subscores were statistically significant when participants performed the 2 test versions. However, when participants performed the same test twice, three of the four Time 1 and Time 2 scores were significantly different, with Time 2 reflecting improved performance and possible learning effects (performance accuracy P = .013; total number of rule breaks P = .015; performance time P = .002).</p><p><strong>Conclusions: </strong>The MODT appears to be an equivalent form of the CQDT that mitigates learning effects that often accompany performance of multitasking assessments. Having developed and validated the equivalence of the CDQT's alternate form, military rehabilitation clinicians have an expanded set of clinical tools by which to identify possible executive dysfunction and evaluate service members' response to rehabilitative care via pre- and post-rehabilitation testing after mild traumatic brain injury.</p>\",\"PeriodicalId\":18638,\"journal\":{\"name\":\"Military Medicine\",\"volume\":\" \",\"pages\":\"601-608\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2025-02-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Military Medicine\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1093/milmed/usae391\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MEDICINE, GENERAL & INTERNAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Military Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/milmed/usae391","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
摘要
导言:轻度脑外伤后,军人可能会在执行功能方面遇到困难,这可能会影响他们重返岗位和生活角色。由于基于表现的多任务评估对执行功能障碍很敏感,一个由军方和民间康复研究人员组成的团队开发了 "冲锋陷阵执勤测试"(CQDT),以帮助了解脑震荡后的执勤准备情况;这是一个基于军事任务场景的多任务测试,对执行功能(如预见和计划、集合转移和前瞻性记忆)提出了挑战。尽管之前的研究表明 CQDT 具有可靠性和已知组的有效性,但与其他多任务测试一样,由于学习效应的影响,该测试不应在康复治疗后重新进行。本研究的目的是开发 CQDT 的替代形式,并评估其与 CQDT 的等效性:研究团队中的主题专家采用迭代法创建了一种替代形式。为了评估等效性,我们采用了重复测量设计,即每位受试者对一个或两个测试版本进行两次测试,并作为自己的对照:研究小组编制了 "维护办公室职责测验"(MODT),即 CQDT 的替代形式。40名成人参加了MODT和CQDT测试,时间相隔约两周;其中4人有服兵役史,16人有后天脑损伤史。我们使用配对 t 检验比较了每项测试 4 个子分数的平均分和标准偏差,发现分数在统计学上没有差异,这表明这两项测试是等效的。此外,在以下情况下,配对 t 检验还用于比较时间 1 和时间 2 的子分数:(1) 参与者进行了两个版本的测试(CQDT 和 MODT);(2) 参与者进行了两次相同的测试。当受试者进行两个版本的测试时,时间 1 和时间 2 子分数的差异均无统计学意义。然而,当受试者进行两次相同的测试时,时间 1 和时间 2 的四项得分中有三项有显著差异,时间 2 反映了成绩的提高和可能的学习效果(成绩准确性 P = .013;规则中断总数 P = .015;成绩时间 P = .002):MODT似乎是CQDT的一种等效形式,可以减轻多任务评估中经常出现的学习效应。在开发并验证了 CDQT 替代形式的等效性之后,军事康复临床医生就有了一套更广泛的临床工具,可用于识别可能存在的执行功能障碍,并通过轻度脑外伤后的康复前和康复后测试评估军人对康复护理的反应。
Development and Evaluation of the Maintenance Office Duty Test: An Alternate Form of the Charge of Quarters Duty Test for Assessing Executive Function After Mild Traumatic Brain Injury to Inform Duty-Readiness After Concussion.
Introduction: After mild traumatic brain injury, service members may experience difficulty with executive functions, which could interfere with return to duty and life roles. Because performance-based multitasking assessments are sensitive to executive dysfunction, a team of military and civilian rehabilitation researchers developed the Charge of Quarters Duty Test (CQDT) to help inform duty readiness after concussion; it is a multitasking test based on a military task scenario that challenges executive functions, such as foresight and planning, set shifting, and prospective memory. Although previous study indicates that CQDT has reliability and known-groups validity, like other multitasking tests, it should not be readministered after rehabilitative care because of learning effects. The purpose of this study was to develop an alternate form of the CQDT and evaluate its equivalence to the CQDT.
Materials and methods: A measurement development study was conducted in which subject matter experts on the study team used an iterative approach to create an alternate form. To evaluate equivalence, a repeated measures design was employed in which each participant performed one or both test versions twice and acted as their own control.
Results: The study team created the Maintenance Office Duty Test (MODT), the alternate form of the CQDT. A convenience sample of 40 adults performed both the MODT and CQDT approximately 2 weeks apart; 4 had a history of military service and 16 had a history of acquired brain injury. We compared mean scores and standard deviations of each test's 4 subscores using matched-pair t-tests and found that scores were not statistically different, suggesting that the 2 tests are equivalent. In addition, matched-pair t-tests were used to compare Time 1 and Time 2 subscores when (1) participants performed the 2 test versions (CQDT and MODT) and (2) participants performed the same test twice. None of the differences in Time 1 and Time 2 subscores were statistically significant when participants performed the 2 test versions. However, when participants performed the same test twice, three of the four Time 1 and Time 2 scores were significantly different, with Time 2 reflecting improved performance and possible learning effects (performance accuracy P = .013; total number of rule breaks P = .015; performance time P = .002).
Conclusions: The MODT appears to be an equivalent form of the CQDT that mitigates learning effects that often accompany performance of multitasking assessments. Having developed and validated the equivalence of the CDQT's alternate form, military rehabilitation clinicians have an expanded set of clinical tools by which to identify possible executive dysfunction and evaluate service members' response to rehabilitative care via pre- and post-rehabilitation testing after mild traumatic brain injury.
期刊介绍:
Military Medicine is the official international journal of AMSUS. Articles published in the journal are peer-reviewed scientific papers, case reports, and editorials. The journal also publishes letters to the editor.
The objective of the journal is to promote awareness of federal medicine by providing a forum for responsible discussion of common ideas and problems relevant to federal healthcare. Its mission is: To increase healthcare education by providing scientific and other information to its readers; to facilitate communication; and to offer a prestige publication for members’ writings.