Inter-rater reliability and agreement of the General Movement Assessment and Motor Optimality Score-Revised in a large population-based sample

IF 2.2 3区医学 Q2 OBSTETRICS & GYNECOLOGY

Early human development Pub Date : 2024-04-25 DOI:10.1016/j.earlhumdev.2024.106019

Caroline Alexander , Natasha Amery , Alison Salt , Catherine Morgan , Alicia Spittle , Robert S. Ware , Catherine Elliott , Jane Valentine

{"title":"Inter-rater reliability and agreement of the General Movement Assessment and Motor Optimality Score-Revised in a large population-based sample","authors":"Caroline Alexander , Natasha Amery , Alison Salt , Catherine Morgan , Alicia Spittle , Robert S. Ware , Catherine Elliott , Jane Valentine","doi":"10.1016/j.earlhumdev.2024.106019","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Prechtl's General Movement Assessment (GMA) at fidgety age (3–5 months) is a widely used tool for early detection of cerebral palsy. Further to GMA classification, detailed assessment of movement patterns at fidgety age is conducted with the Motor Optimality Score-Revised (MOS-R). Inter-rater reliability and agreement are properties that inform test application and interpretation in clinical and research settings. This study aims to establish the inter-rater reliability and agreement of the GMA classification and MOS-R in a large population-based sample.</p></div><div><h3>Methods</h3><p>A cross-sectional study of 773 infants from birth-cohort in Perth, Western Australia. GMA was conducted on home-recorded videos collected between 12 + 0 and 16 + 6 weeks post term age. Videos were independently scored by two masked experienced assessors. Inter-rater reliability and agreement were assessed using intraclass correlation coefficient and limits of agreement respectively for continuous variables, and Cohen's Kappa and Gwet's Agreement Coefficient, and percentage agreement respectively for discrete variables.</p></div><div><h3>Results</h3><p>The classification of GMA showed almost perfect reliability (AC<sub>1</sub> = 0.999) and agreement (99.9 %). Total MOS-R scores showed good-excellent reliability (ICC 0.857, 95 % CI 0.838–0.876) and clinically acceptable agreement (95 % limits of agreement of ±2.5 points). Substantial to almost perfect reliability and agreement were found for all MOS-R domain subscores. While MOS-R domains with higher redundancy in their categorisation have higher reliability and agreement, inter-rater reliability and agreement are substantial to almost perfect at the item level and are consistent across domains.</p></div><div><h3>Conclusion</h3><p>GMA at fidgety age shows clinically acceptable inter-rater reliability and agreement for GMA classification and MOS-R for population-based cohorts assessed by experienced assessors.</p></div>","PeriodicalId":11435,"journal":{"name":"Early human development","volume":"193 ","pages":"Article 106019"},"PeriodicalIF":2.2000,"publicationDate":"2024-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0378378224000884/pdfft?md5=99e18f8a17fec75e574995483c934749&pid=1-s2.0-S0378378224000884-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Early human development","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378378224000884","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

Background

Prechtl's General Movement Assessment (GMA) at fidgety age (3–5 months) is a widely used tool for early detection of cerebral palsy. Further to GMA classification, detailed assessment of movement patterns at fidgety age is conducted with the Motor Optimality Score-Revised (MOS-R). Inter-rater reliability and agreement are properties that inform test application and interpretation in clinical and research settings. This study aims to establish the inter-rater reliability and agreement of the GMA classification and MOS-R in a large population-based sample.

Methods

A cross-sectional study of 773 infants from birth-cohort in Perth, Western Australia. GMA was conducted on home-recorded videos collected between 12 + 0 and 16 + 6 weeks post term age. Videos were independently scored by two masked experienced assessors. Inter-rater reliability and agreement were assessed using intraclass correlation coefficient and limits of agreement respectively for continuous variables, and Cohen's Kappa and Gwet's Agreement Coefficient, and percentage agreement respectively for discrete variables.

Results

The classification of GMA showed almost perfect reliability (AC₁ = 0.999) and agreement (99.9 %). Total MOS-R scores showed good-excellent reliability (ICC 0.857, 95 % CI 0.838–0.876) and clinically acceptable agreement (95 % limits of agreement of ±2.5 points). Substantial to almost perfect reliability and agreement were found for all MOS-R domain subscores. While MOS-R domains with higher redundancy in their categorisation have higher reliability and agreement, inter-rater reliability and agreement are substantial to almost perfect at the item level and are consistent across domains.

Conclusion

GMA at fidgety age shows clinically acceptable inter-rater reliability and agreement for GMA classification and MOS-R for population-based cohorts assessed by experienced assessors.

查看原文本刊更多论文

在大型人口抽样调查中修订的一般运动评估和运动优化评分的评分者间可靠性和一致性

背景Prechtl在躁动期（3-5个月）进行的一般运动评估（GMA）是一种广泛使用的早期发现脑瘫的工具。在对 GMA 进行分类的基础上，还采用运动优化评分-修订版（MOS-R）对躁动期的运动模式进行了详细评估。评分者之间的可靠性和一致性是临床和研究中应用和解释测试的依据。本研究的目的是在一个大样本人群中建立 GMA 分类和 MOS-R 的评分者间可靠性和一致性。方法对西澳大利亚珀斯出生队列中的 773 名婴儿进行横断面研究。GMA 是在产后 12+0 周至 16+6 周期间收集的家庭录制视频上进行的。视频由两名蒙面的资深评估员独立评分。对于连续变量，分别使用类内相关系数（intra-class correlation coefficient）和一致度（limit of agreement）进行评估；对于离散变量，分别使用科恩卡帕系数（Cohen's Kappa）和格维特一致系数（Gwet's Agreement Coefficient）以及一致度百分比进行评估。MOS-R 总分显示出良好的可靠性（ICC 0.857，95 % CI 0.838-0.876）和临床上可接受的一致性（95 % 的一致性范围为 ±2.5 分）。所有MOS-R领域的子分数都具有很高甚至近乎完美的可靠性和一致性。结论对于由经验丰富的评估员进行评估的人群，烦躁不安年龄组的 GMA 分类和 MOS-R 显示出临床上可接受的评估员之间的可靠性和一致性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Early human development 医学-妇产科学

CiteScore

4.40

自引率

4.00%

发文量

100

审稿时长

46 days

期刊介绍： Established as an authoritative, highly cited voice on early human development, Early Human Development provides a unique opportunity for researchers and clinicians to bridge the communication gap between disciplines. Creating a forum for the productive exchange of ideas concerning early human growth and development, the journal publishes original research and clinical papers with particular emphasis on the continuum between fetal life and the perinatal period; aspects of postnatal growth influenced by early events; and the safeguarding of the quality of human survival. The first comprehensive and interdisciplinary journal in this area of growing importance, Early Human Development offers pertinent contributions to the following subject areas: Fetology; perinatology; pediatrics; growth and development; obstetrics; reproduction and fertility; epidemiology; behavioural sciences; nutrition and metabolism; teratology; neurology; brain biology; developmental psychology and screening.