Jordan Glenn, Parmoon Sarmadi, Paul Cristman, Gabrielle Kim, Ting-Hsuan Lin, Vikram Kashyap
{"title":"Using the TrueLoo Smart Device to Record Toileting Sessions in Older Adults: Retrospective Validation and Acceptance Study.","authors":"Jordan Glenn, Parmoon Sarmadi, Paul Cristman, Gabrielle Kim, Ting-Hsuan Lin, Vikram Kashyap","doi":"10.2196/50856","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Because of the relationship between independent living and activities of daily living, care teams spend significant time managing assisted living residents' toileting problems. Recently, the TrueLoo was developed as a connected toilet seat to automatically log and monitor toileting sessions.</p><p><strong>Objective: </strong>This study aimed to demonstrate the validity of the TrueLoo to (1) record and identify toileting sessions with regard to stool and urine events; (2) compare the results with the person-reported, standard-of-care methods; and (3) establish metrics of user acceptability and ease of use in a assisted living facility population.</p><p><strong>Methods: </strong>We used two phases: (1) initial development of the TrueLoo algorithms to accurately identify urine and stool events and (2) evaluation of the algorithms against person-reported, standard-of-care methods commonly used in assisted living facilities. Phase 2 analyzed data over a 3-day period from 52 devices. Participants' age ranged from 63 to 101 (mean 84, SD 9.35) years. Acceptability and ease-of-use data were also collected.</p><p><strong>Results: </strong>Regarding the development of the TrueLoo algorithm for urine assessment, sensitivity and specificity of 96% and 85% were observed when evaluating a gold-standard labeled data set, respectively (F<sub>1</sub>-score=0.95). For stool, sensitivity and specificity of 90% and 79% were observed, respectively (F<sub>1</sub>-score=0.85). Regarding the TrueLoo algorithm in assisted living settings, classification performance statistics for urine assessment revealed sensitivity and specificity of 84% and 94%, respectively (F<sub>1</sub>-score=0.90), and for stool, 92% and 98%, respectively (F<sub>1</sub>-score=0.91). Throughout the study, 46 person-reported instances of urine were documented, compared with 630 recorded by the TrueLoo. For stool events, 116 person-reported events were reported, compared with 153 by the TrueLoo. This indicates that person-reported events were captured 7% (46/630) of the time for urine and 76% (116/153) of the time for stool. Overall, 45% (32/71) of participants said that the new toilet seat was better than their previous one, 84% (60/71) reported that using the TrueLoo was easy, and 99% (69/71) said that they believed the system could help aging adults. Over 98% (69/71) of participants reported that they would find alerts related to their health valuable and would be willing to share this information with their doctor. When asked about sharing information with caregivers, 66% (46/71) reported that they would prefer the TrueLoo to send information and alerts to their caregiver, as opposed to the participant having to personally communicate those details.</p><p><strong>Conclusions: </strong>The TrueLoo accurately recorded toileting sessions compared with standard-of-care methods, successfully establishing metrics of user acceptability and ease of use in assisted living populations. While additional validation studies are warranted, data presented in this paper support the use of the TrueLoo in assisted living settings as a model of event monitoring during toileting.</p>","PeriodicalId":36245,"journal":{"name":"JMIR Aging","volume":"7 ","pages":"e50856"},"PeriodicalIF":5.0000,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11165284/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Aging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/50856","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Because of the relationship between independent living and activities of daily living, care teams spend significant time managing assisted living residents' toileting problems. Recently, the TrueLoo was developed as a connected toilet seat to automatically log and monitor toileting sessions.
Objective: This study aimed to demonstrate the validity of the TrueLoo to (1) record and identify toileting sessions with regard to stool and urine events; (2) compare the results with the person-reported, standard-of-care methods; and (3) establish metrics of user acceptability and ease of use in a assisted living facility population.
Methods: We used two phases: (1) initial development of the TrueLoo algorithms to accurately identify urine and stool events and (2) evaluation of the algorithms against person-reported, standard-of-care methods commonly used in assisted living facilities. Phase 2 analyzed data over a 3-day period from 52 devices. Participants' age ranged from 63 to 101 (mean 84, SD 9.35) years. Acceptability and ease-of-use data were also collected.
Results: Regarding the development of the TrueLoo algorithm for urine assessment, sensitivity and specificity of 96% and 85% were observed when evaluating a gold-standard labeled data set, respectively (F1-score=0.95). For stool, sensitivity and specificity of 90% and 79% were observed, respectively (F1-score=0.85). Regarding the TrueLoo algorithm in assisted living settings, classification performance statistics for urine assessment revealed sensitivity and specificity of 84% and 94%, respectively (F1-score=0.90), and for stool, 92% and 98%, respectively (F1-score=0.91). Throughout the study, 46 person-reported instances of urine were documented, compared with 630 recorded by the TrueLoo. For stool events, 116 person-reported events were reported, compared with 153 by the TrueLoo. This indicates that person-reported events were captured 7% (46/630) of the time for urine and 76% (116/153) of the time for stool. Overall, 45% (32/71) of participants said that the new toilet seat was better than their previous one, 84% (60/71) reported that using the TrueLoo was easy, and 99% (69/71) said that they believed the system could help aging adults. Over 98% (69/71) of participants reported that they would find alerts related to their health valuable and would be willing to share this information with their doctor. When asked about sharing information with caregivers, 66% (46/71) reported that they would prefer the TrueLoo to send information and alerts to their caregiver, as opposed to the participant having to personally communicate those details.
Conclusions: The TrueLoo accurately recorded toileting sessions compared with standard-of-care methods, successfully establishing metrics of user acceptability and ease of use in assisted living populations. While additional validation studies are warranted, data presented in this paper support the use of the TrueLoo in assisted living settings as a model of event monitoring during toileting.