Tom McKeever, Michael Leavitt, Stephanie Valentin, Conor Hurley, Arran Fraser, David F Hamilton
{"title":"野外SCAT6评估工具在成人人群中的测试间信度和重测信度","authors":"Tom McKeever, Michael Leavitt, Stephanie Valentin, Conor Hurley, Arran Fraser, David F Hamilton","doi":"10.1097/HTR.0000000000001106","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>No previously published repeatability and reliability data for The Sports Concussion Assessment Tool-6 (SCAT6) exists. We aimed to evaluate inter/intra-tester reliability of the off-field SCAT6 in a non-concussed adult population.</p><p><strong>Design: </strong>Inter-rater and Intra-rater reliability study design.</p><p><strong>Setting: </strong>Single university site.</p><p><strong>Participants: </strong>Twenty active adults (mean age: 27.55 ± 5.59 years) with no recent history of concussion (Concussive injury within past year).</p><p><strong>Interventions: </strong>Participants completed 3 SCAT6 tests on the same day, with 3 testers (Inter-rater testing). The same participants returned at 2 further time points to complete the remaining 2 SCAT6 tests with 1 tester (Intra-rater testing). Participants complete a total of 5 SCAT6 assessments in total across testers and time. Rater Background: Those completing the SCAT6 testing, our study rater team, comprised of 1 senior physiotherapist and PhD candidate, and 2 MSc Physiotherapy students. All raters were from Scotland, and had significant training in completing SCAT6 assessments.</p><p><strong>Main outcome measures: </strong>Off-field SCAT6 Domain scores.</p><p><strong>Analysis: </strong>ICCs were used to establish inter and intra-rater reliability for continuous, ration and ordinal data components of the SCAT6. For nominal data sets, Fleiss's kappa was calculated. Kendall's W was used for non-parametric data. Percentage error scores were calculated for SCAT6 domains.</p><p><strong>Results: </strong>Inter-tester: Symptom number, severity, and dual-task scoring demonstrated excellent reliability (ICC = 0.981; 0.984; 0.913, respectively). Total concentration score was found to have good reliability (0.827). Dual-task errors (0.398), Total mBESS (0.199), and Month recall all returned poor scores (k = 0.191). Intra-tester: Dual tasking was the only domain to report excellent reliability (ICC = 0.943). Symptom number (0.868), severity (0.831), total concentration (0.787), total mBESS (0.813), and time tandem gait (0.834) yielded good reliability scores. Dual-task error testing returned poor reliability scores (Kendall's W = 0.001). All remaining domains yielded moderate reliability. Percentage error rates ranges from 3% to 100%, demonstrating the variability between scores yielded for non-concussed individuals completing the same SCAT6 domain tests.</p><p><strong>Conclusion: </strong>SCAT6 ICC results reported good-excellent reliability for 4 and 6 domains, out of 13 domains, for inter-tester and intra-tester reliability, respectively. Notably, the domains which relied on tester error scoring yielded poor reliability results. Percentage error highlighted the failure of the SCAT6 to provide consistent domain score results in this population.</p>","PeriodicalId":15901,"journal":{"name":"Journal of Head Trauma Rehabilitation","volume":" ","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2025-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Inter-Tester and Test-Retest Reliability of the Off-Field SCAT6 Assessment Tool In An Adult Population.\",\"authors\":\"Tom McKeever, Michael Leavitt, Stephanie Valentin, Conor Hurley, Arran Fraser, David F Hamilton\",\"doi\":\"10.1097/HTR.0000000000001106\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>No previously published repeatability and reliability data for The Sports Concussion Assessment Tool-6 (SCAT6) exists. We aimed to evaluate inter/intra-tester reliability of the off-field SCAT6 in a non-concussed adult population.</p><p><strong>Design: </strong>Inter-rater and Intra-rater reliability study design.</p><p><strong>Setting: </strong>Single university site.</p><p><strong>Participants: </strong>Twenty active adults (mean age: 27.55 ± 5.59 years) with no recent history of concussion (Concussive injury within past year).</p><p><strong>Interventions: </strong>Participants completed 3 SCAT6 tests on the same day, with 3 testers (Inter-rater testing). The same participants returned at 2 further time points to complete the remaining 2 SCAT6 tests with 1 tester (Intra-rater testing). Participants complete a total of 5 SCAT6 assessments in total across testers and time. Rater Background: Those completing the SCAT6 testing, our study rater team, comprised of 1 senior physiotherapist and PhD candidate, and 2 MSc Physiotherapy students. All raters were from Scotland, and had significant training in completing SCAT6 assessments.</p><p><strong>Main outcome measures: </strong>Off-field SCAT6 Domain scores.</p><p><strong>Analysis: </strong>ICCs were used to establish inter and intra-rater reliability for continuous, ration and ordinal data components of the SCAT6. For nominal data sets, Fleiss's kappa was calculated. Kendall's W was used for non-parametric data. Percentage error scores were calculated for SCAT6 domains.</p><p><strong>Results: </strong>Inter-tester: Symptom number, severity, and dual-task scoring demonstrated excellent reliability (ICC = 0.981; 0.984; 0.913, respectively). Total concentration score was found to have good reliability (0.827). Dual-task errors (0.398), Total mBESS (0.199), and Month recall all returned poor scores (k = 0.191). Intra-tester: Dual tasking was the only domain to report excellent reliability (ICC = 0.943). Symptom number (0.868), severity (0.831), total concentration (0.787), total mBESS (0.813), and time tandem gait (0.834) yielded good reliability scores. Dual-task error testing returned poor reliability scores (Kendall's W = 0.001). All remaining domains yielded moderate reliability. Percentage error rates ranges from 3% to 100%, demonstrating the variability between scores yielded for non-concussed individuals completing the same SCAT6 domain tests.</p><p><strong>Conclusion: </strong>SCAT6 ICC results reported good-excellent reliability for 4 and 6 domains, out of 13 domains, for inter-tester and intra-tester reliability, respectively. Notably, the domains which relied on tester error scoring yielded poor reliability results. Percentage error highlighted the failure of the SCAT6 to provide consistent domain score results in this population.</p>\",\"PeriodicalId\":15901,\"journal\":{\"name\":\"Journal of Head Trauma Rehabilitation\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-08-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Head Trauma Rehabilitation\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1097/HTR.0000000000001106\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Head Trauma Rehabilitation","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/HTR.0000000000001106","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
The Inter-Tester and Test-Retest Reliability of the Off-Field SCAT6 Assessment Tool In An Adult Population.
Objective: No previously published repeatability and reliability data for The Sports Concussion Assessment Tool-6 (SCAT6) exists. We aimed to evaluate inter/intra-tester reliability of the off-field SCAT6 in a non-concussed adult population.
Design: Inter-rater and Intra-rater reliability study design.
Setting: Single university site.
Participants: Twenty active adults (mean age: 27.55 ± 5.59 years) with no recent history of concussion (Concussive injury within past year).
Interventions: Participants completed 3 SCAT6 tests on the same day, with 3 testers (Inter-rater testing). The same participants returned at 2 further time points to complete the remaining 2 SCAT6 tests with 1 tester (Intra-rater testing). Participants complete a total of 5 SCAT6 assessments in total across testers and time. Rater Background: Those completing the SCAT6 testing, our study rater team, comprised of 1 senior physiotherapist and PhD candidate, and 2 MSc Physiotherapy students. All raters were from Scotland, and had significant training in completing SCAT6 assessments.
Main outcome measures: Off-field SCAT6 Domain scores.
Analysis: ICCs were used to establish inter and intra-rater reliability for continuous, ration and ordinal data components of the SCAT6. For nominal data sets, Fleiss's kappa was calculated. Kendall's W was used for non-parametric data. Percentage error scores were calculated for SCAT6 domains.
Results: Inter-tester: Symptom number, severity, and dual-task scoring demonstrated excellent reliability (ICC = 0.981; 0.984; 0.913, respectively). Total concentration score was found to have good reliability (0.827). Dual-task errors (0.398), Total mBESS (0.199), and Month recall all returned poor scores (k = 0.191). Intra-tester: Dual tasking was the only domain to report excellent reliability (ICC = 0.943). Symptom number (0.868), severity (0.831), total concentration (0.787), total mBESS (0.813), and time tandem gait (0.834) yielded good reliability scores. Dual-task error testing returned poor reliability scores (Kendall's W = 0.001). All remaining domains yielded moderate reliability. Percentage error rates ranges from 3% to 100%, demonstrating the variability between scores yielded for non-concussed individuals completing the same SCAT6 domain tests.
Conclusion: SCAT6 ICC results reported good-excellent reliability for 4 and 6 domains, out of 13 domains, for inter-tester and intra-tester reliability, respectively. Notably, the domains which relied on tester error scoring yielded poor reliability results. Percentage error highlighted the failure of the SCAT6 to provide consistent domain score results in this population.
期刊介绍:
The Journal of Head Trauma Rehabilitation is a leading, peer-reviewed resource that provides up-to-date information on the clinical management and rehabilitation of persons with traumatic brain injuries. Six issues each year aspire to the vision of “knowledge informing care” and include a wide range of articles, topical issues, commentaries and special features. It is the official journal of the Brain Injury Association of America (BIAA).