Charles E Matthews, Pedro Saint-Maurice, Joshua R Freeman, Hayden A Hayes, Alaina H Shreves, Aiden Doherty, Eric T Hyde, Katie Ylarregui, Rena R Jones, Sarah K Keadle
{"title":"在自由生活的成年人中使用腕带传感器估计每天久坐时间的算法的性能评估。","authors":"Charles E Matthews, Pedro Saint-Maurice, Joshua R Freeman, Hayden A Hayes, Alaina H Shreves, Aiden Doherty, Eric T Hyde, Katie Ylarregui, Rena R Jones, Sarah K Keadle","doi":"10.1123/jmpb.2024-0051","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Given the limited real-world testing of algorithms for wrist-worn sensors to estimate sedentary time, we examined the performance of 21 algorithms in free-living adults.</p><p><strong>Methods: </strong>Seventy-one adults (35-65 years) wore a GENEActiv (wrist) and an activPAL (thigh) sensor for up to 10 days. activPAL was our reference measure. We estimated sedentary time (hours/day) using 21 classification algorithms, including cut point and machine-learning methods. Valid days from each monitor were matched by date and mean values were calculated. Equivalence testing (±10%) and linear regression were used to compare each algorithm's estimate to the reference, over all participants and by sex and age.</p><p><strong>Results: </strong>activPAL recorded a mean of 9.4 hours/d sedentary. Five of 21 algorithms (24%) estimated sedentary time within 10% (±0.94 hours) of the reference. Two of these methods employed machine-learning algorithms (Trost Extended, OxWearables) and three employed cut points (GGIR ENMO 40mg; Bakrania ENMO 32.6mg; Fraysse ENMOa 62.5mg). Variance explained in linear regression was relatively high for the machine-learning (R<sup>2</sup>=0.44-0.63) and cut point algorithms developed for younger (R<sup>2</sup>=0.30-0.64) and older (R<sup>2</sup>=0.45-0.66) adults. More accurate performance was noted for algorithms developed in studies using posture-based ground truth measures and conducted in free-living settings.</p><p><strong>Conclusion: </strong>Fifteen of 21 (71%) algorithms produced estimates of sedentary time that were moderate-strongly correlated with the reference measure, but only five (24%) were within 10% of the reference. Free-living benchmarking studies like this can identify more accurate and precise algorithms to estimate sedentary time and identify characteristics of algorithm development studies that yield better results.</p>","PeriodicalId":73572,"journal":{"name":"Journal for the measurement of physical behaviour","volume":"8 1","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12363551/pdf/","citationCount":"0","resultStr":"{\"title\":\"Performance evaluation of algorithms to estimate daily sedentary time using wrist-worn sensors in free-living adults.\",\"authors\":\"Charles E Matthews, Pedro Saint-Maurice, Joshua R Freeman, Hayden A Hayes, Alaina H Shreves, Aiden Doherty, Eric T Hyde, Katie Ylarregui, Rena R Jones, Sarah K Keadle\",\"doi\":\"10.1123/jmpb.2024-0051\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Given the limited real-world testing of algorithms for wrist-worn sensors to estimate sedentary time, we examined the performance of 21 algorithms in free-living adults.</p><p><strong>Methods: </strong>Seventy-one adults (35-65 years) wore a GENEActiv (wrist) and an activPAL (thigh) sensor for up to 10 days. activPAL was our reference measure. We estimated sedentary time (hours/day) using 21 classification algorithms, including cut point and machine-learning methods. Valid days from each monitor were matched by date and mean values were calculated. Equivalence testing (±10%) and linear regression were used to compare each algorithm's estimate to the reference, over all participants and by sex and age.</p><p><strong>Results: </strong>activPAL recorded a mean of 9.4 hours/d sedentary. Five of 21 algorithms (24%) estimated sedentary time within 10% (±0.94 hours) of the reference. Two of these methods employed machine-learning algorithms (Trost Extended, OxWearables) and three employed cut points (GGIR ENMO 40mg; Bakrania ENMO 32.6mg; Fraysse ENMOa 62.5mg). Variance explained in linear regression was relatively high for the machine-learning (R<sup>2</sup>=0.44-0.63) and cut point algorithms developed for younger (R<sup>2</sup>=0.30-0.64) and older (R<sup>2</sup>=0.45-0.66) adults. More accurate performance was noted for algorithms developed in studies using posture-based ground truth measures and conducted in free-living settings.</p><p><strong>Conclusion: </strong>Fifteen of 21 (71%) algorithms produced estimates of sedentary time that were moderate-strongly correlated with the reference measure, but only five (24%) were within 10% of the reference. Free-living benchmarking studies like this can identify more accurate and precise algorithms to estimate sedentary time and identify characteristics of algorithm development studies that yield better results.</p>\",\"PeriodicalId\":73572,\"journal\":{\"name\":\"Journal for the measurement of physical behaviour\",\"volume\":\"8 1\",\"pages\":\"\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12363551/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal for the measurement of physical behaviour\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1123/jmpb.2024-0051\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/6/10 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal for the measurement of physical behaviour","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1123/jmpb.2024-0051","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/6/10 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
Performance evaluation of algorithms to estimate daily sedentary time using wrist-worn sensors in free-living adults.
Purpose: Given the limited real-world testing of algorithms for wrist-worn sensors to estimate sedentary time, we examined the performance of 21 algorithms in free-living adults.
Methods: Seventy-one adults (35-65 years) wore a GENEActiv (wrist) and an activPAL (thigh) sensor for up to 10 days. activPAL was our reference measure. We estimated sedentary time (hours/day) using 21 classification algorithms, including cut point and machine-learning methods. Valid days from each monitor were matched by date and mean values were calculated. Equivalence testing (±10%) and linear regression were used to compare each algorithm's estimate to the reference, over all participants and by sex and age.
Results: activPAL recorded a mean of 9.4 hours/d sedentary. Five of 21 algorithms (24%) estimated sedentary time within 10% (±0.94 hours) of the reference. Two of these methods employed machine-learning algorithms (Trost Extended, OxWearables) and three employed cut points (GGIR ENMO 40mg; Bakrania ENMO 32.6mg; Fraysse ENMOa 62.5mg). Variance explained in linear regression was relatively high for the machine-learning (R2=0.44-0.63) and cut point algorithms developed for younger (R2=0.30-0.64) and older (R2=0.45-0.66) adults. More accurate performance was noted for algorithms developed in studies using posture-based ground truth measures and conducted in free-living settings.
Conclusion: Fifteen of 21 (71%) algorithms produced estimates of sedentary time that were moderate-strongly correlated with the reference measure, but only five (24%) were within 10% of the reference. Free-living benchmarking studies like this can identify more accurate and precise algorithms to estimate sedentary time and identify characteristics of algorithm development studies that yield better results.