{"title":"探索计算构音障碍最小可检测变化的方法学决定:可靠性、统计和测量的标准误差。","authors":"Kelly E Gates, Antje S Mefferd, Kaila L Stipancic","doi":"10.1044/2025_JSLHR-24-00899","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The minimally detectable change (MDC), widely used in rehabilitation sciences to interpret changes in outcome measures, is calculated using a reliability method, reliability statistic, and standard error of measurement (<i>SEM</i>). This study examined how different methodological choices affect MDC thresholds of speech intelligibility in speakers with dysarthria. The goals of this study were to compare MDCs calculated using (a) three different reliability methods, (b) two different reliability statistics, and (c) three different <i>SEM</i> calculations.</p><p><strong>Method: </strong>Recordings of the Speech Intelligibility Test from 200 speakers including speakers with amyotrophic lateral sclerosis (<i>n</i> = 16), Huntington's disease (<i>n</i> = 44), multiple sclerosis (<i>n</i> = 60), and Parkinson's disease (<i>n</i> = 40), along with healthy controls (<i>n</i> = 40), were drawn from two databases. Thirty inexperienced listeners completed two sessions, providing orthographic transcriptions of 20 speakers. MDCs of intelligibility were calculated using (a) three reliability methods (i.e., test-retest, split-half, and intrarater), (b) two reliability statistics (i.e., Pearson <i>r</i> and intraclass correlation coefficients [ICCs]), and (c) three different formulas for calculating the <i>SEM</i>. Kruskal-Wallis tests were used to assess the effects of reliability methods, statistics, and <i>SEM</i> calculations.</p><p><strong>Results: </strong>Significant differences were found between the MDCs when using split-half and test-retest reliability, when using Pearson <i>r</i> and ICC, and when using two of the three <i>SEM</i> calculations.</p><p><strong>Conclusions: </strong>Results demonstrate that methodological decisions can impact MDCs of speech intelligibility in speakers with dysarthria, highlighting the need for specific, detailed reporting of methodology used to calculate MDCs in future work. Findings can provide methodological guidance for future studies and contextualize existing research on intelligibility changes.</p>","PeriodicalId":520690,"journal":{"name":"Journal of speech, language, and hearing research : JSLHR","volume":" ","pages":"1-18"},"PeriodicalIF":2.2000,"publicationDate":"2025-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Exploring Methodological Decisions for Calculating the Minimally Detectable Change in Dysarthria: Reliability, Statistics, and Standard Error of Measurement.\",\"authors\":\"Kelly E Gates, Antje S Mefferd, Kaila L Stipancic\",\"doi\":\"10.1044/2025_JSLHR-24-00899\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>The minimally detectable change (MDC), widely used in rehabilitation sciences to interpret changes in outcome measures, is calculated using a reliability method, reliability statistic, and standard error of measurement (<i>SEM</i>). This study examined how different methodological choices affect MDC thresholds of speech intelligibility in speakers with dysarthria. The goals of this study were to compare MDCs calculated using (a) three different reliability methods, (b) two different reliability statistics, and (c) three different <i>SEM</i> calculations.</p><p><strong>Method: </strong>Recordings of the Speech Intelligibility Test from 200 speakers including speakers with amyotrophic lateral sclerosis (<i>n</i> = 16), Huntington's disease (<i>n</i> = 44), multiple sclerosis (<i>n</i> = 60), and Parkinson's disease (<i>n</i> = 40), along with healthy controls (<i>n</i> = 40), were drawn from two databases. Thirty inexperienced listeners completed two sessions, providing orthographic transcriptions of 20 speakers. MDCs of intelligibility were calculated using (a) three reliability methods (i.e., test-retest, split-half, and intrarater), (b) two reliability statistics (i.e., Pearson <i>r</i> and intraclass correlation coefficients [ICCs]), and (c) three different formulas for calculating the <i>SEM</i>. Kruskal-Wallis tests were used to assess the effects of reliability methods, statistics, and <i>SEM</i> calculations.</p><p><strong>Results: </strong>Significant differences were found between the MDCs when using split-half and test-retest reliability, when using Pearson <i>r</i> and ICC, and when using two of the three <i>SEM</i> calculations.</p><p><strong>Conclusions: </strong>Results demonstrate that methodological decisions can impact MDCs of speech intelligibility in speakers with dysarthria, highlighting the need for specific, detailed reporting of methodology used to calculate MDCs in future work. Findings can provide methodological guidance for future studies and contextualize existing research on intelligibility changes.</p>\",\"PeriodicalId\":520690,\"journal\":{\"name\":\"Journal of speech, language, and hearing research : JSLHR\",\"volume\":\" \",\"pages\":\"1-18\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2025-07-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of speech, language, and hearing research : JSLHR\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1044/2025_JSLHR-24-00899\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of speech, language, and hearing research : JSLHR","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1044/2025_JSLHR-24-00899","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Exploring Methodological Decisions for Calculating the Minimally Detectable Change in Dysarthria: Reliability, Statistics, and Standard Error of Measurement.
Purpose: The minimally detectable change (MDC), widely used in rehabilitation sciences to interpret changes in outcome measures, is calculated using a reliability method, reliability statistic, and standard error of measurement (SEM). This study examined how different methodological choices affect MDC thresholds of speech intelligibility in speakers with dysarthria. The goals of this study were to compare MDCs calculated using (a) three different reliability methods, (b) two different reliability statistics, and (c) three different SEM calculations.
Method: Recordings of the Speech Intelligibility Test from 200 speakers including speakers with amyotrophic lateral sclerosis (n = 16), Huntington's disease (n = 44), multiple sclerosis (n = 60), and Parkinson's disease (n = 40), along with healthy controls (n = 40), were drawn from two databases. Thirty inexperienced listeners completed two sessions, providing orthographic transcriptions of 20 speakers. MDCs of intelligibility were calculated using (a) three reliability methods (i.e., test-retest, split-half, and intrarater), (b) two reliability statistics (i.e., Pearson r and intraclass correlation coefficients [ICCs]), and (c) three different formulas for calculating the SEM. Kruskal-Wallis tests were used to assess the effects of reliability methods, statistics, and SEM calculations.
Results: Significant differences were found between the MDCs when using split-half and test-retest reliability, when using Pearson r and ICC, and when using two of the three SEM calculations.
Conclusions: Results demonstrate that methodological decisions can impact MDCs of speech intelligibility in speakers with dysarthria, highlighting the need for specific, detailed reporting of methodology used to calculate MDCs in future work. Findings can provide methodological guidance for future studies and contextualize existing research on intelligibility changes.