Robert D Sandler, Lana Lai, Sophie Dawson, Sarah Cameron, Aoife Lynam, Matthew Sperrin, Zhe Hui Hoo, Martin J Wildman
{"title":"开发数据处理算法,计算使用吸入疗法的成年囊性纤维化患者的依从性--CFHealthHub 学习健康系统内的一项多中心观察研究。","authors":"Robert D Sandler, Lana Lai, Sophie Dawson, Sarah Cameron, Aoife Lynam, Matthew Sperrin, Zhe Hui Hoo, Martin J Wildman","doi":"10.1080/14737167.2024.2328085","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>To develop a robust algorithm to accurately calculate 'daily complete dose counts' for inhaled medicines, used in percent adherence calculations, from electronically-captured nebulizer data within the CFHealthHub Learning Health System.</p><p><strong>Methods: </strong>A multi-center, cross-sectional study involved participants and clinicians reviewing real-world inhaled medicine usage records and triangulating them with objective nebulizer data to establish a consensus on 'daily complete dose counts.' An algorithm, which used only objective nebulizer data, was then developed using a derivation dataset and evaluated using internal validation dataset. The agreement and accuracy between the algorithm-derived and consensus-derived 'daily complete dose counts' was examined, with the consensus-derived count as the reference standard.</p><p><strong>Results: </strong>Twelve people with CF participated. The algorithm derived a 'daily complete dose count' by screening out 'invalid' doses (those <60s in duration or run in cleaning mode), combining all doses starting within 120s of each other, and then screening out all doses with duration < 480s which were interrupted by power supply failure. The kappa co-efficient was 0.85 (0.71-0.91) in the derivation and 0.86 (0.77-0.94) in the validation dataset.</p><p><strong>Conclusions: </strong>The algorithm demonstrated strong agreement with the participant-clinician consensus, enhancing confidence in CFHealthHub data. Publishingdata processing methods can encourage trust in digital endpoints and serve as an exemplar for other projects.</p>","PeriodicalId":12244,"journal":{"name":"Expert Review of Pharmacoeconomics & Outcomes Research","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of data processing algorithm to calculate adherence for adults with cystic fibrosis using inhaled therapy - a multi-center observational study within the CFHealthHub learning health system.\",\"authors\":\"Robert D Sandler, Lana Lai, Sophie Dawson, Sarah Cameron, Aoife Lynam, Matthew Sperrin, Zhe Hui Hoo, Martin J Wildman\",\"doi\":\"10.1080/14737167.2024.2328085\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>To develop a robust algorithm to accurately calculate 'daily complete dose counts' for inhaled medicines, used in percent adherence calculations, from electronically-captured nebulizer data within the CFHealthHub Learning Health System.</p><p><strong>Methods: </strong>A multi-center, cross-sectional study involved participants and clinicians reviewing real-world inhaled medicine usage records and triangulating them with objective nebulizer data to establish a consensus on 'daily complete dose counts.' An algorithm, which used only objective nebulizer data, was then developed using a derivation dataset and evaluated using internal validation dataset. The agreement and accuracy between the algorithm-derived and consensus-derived 'daily complete dose counts' was examined, with the consensus-derived count as the reference standard.</p><p><strong>Results: </strong>Twelve people with CF participated. The algorithm derived a 'daily complete dose count' by screening out 'invalid' doses (those <60s in duration or run in cleaning mode), combining all doses starting within 120s of each other, and then screening out all doses with duration < 480s which were interrupted by power supply failure. The kappa co-efficient was 0.85 (0.71-0.91) in the derivation and 0.86 (0.77-0.94) in the validation dataset.</p><p><strong>Conclusions: </strong>The algorithm demonstrated strong agreement with the participant-clinician consensus, enhancing confidence in CFHealthHub data. Publishingdata processing methods can encourage trust in digital endpoints and serve as an exemplar for other projects.</p>\",\"PeriodicalId\":12244,\"journal\":{\"name\":\"Expert Review of Pharmacoeconomics & Outcomes Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2024-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Review of Pharmacoeconomics & Outcomes Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/14737167.2024.2328085\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/3/12 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Review of Pharmacoeconomics & Outcomes Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/14737167.2024.2328085","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/3/12 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
Development of data processing algorithm to calculate adherence for adults with cystic fibrosis using inhaled therapy - a multi-center observational study within the CFHealthHub learning health system.
Objectives: To develop a robust algorithm to accurately calculate 'daily complete dose counts' for inhaled medicines, used in percent adherence calculations, from electronically-captured nebulizer data within the CFHealthHub Learning Health System.
Methods: A multi-center, cross-sectional study involved participants and clinicians reviewing real-world inhaled medicine usage records and triangulating them with objective nebulizer data to establish a consensus on 'daily complete dose counts.' An algorithm, which used only objective nebulizer data, was then developed using a derivation dataset and evaluated using internal validation dataset. The agreement and accuracy between the algorithm-derived and consensus-derived 'daily complete dose counts' was examined, with the consensus-derived count as the reference standard.
Results: Twelve people with CF participated. The algorithm derived a 'daily complete dose count' by screening out 'invalid' doses (those <60s in duration or run in cleaning mode), combining all doses starting within 120s of each other, and then screening out all doses with duration < 480s which were interrupted by power supply failure. The kappa co-efficient was 0.85 (0.71-0.91) in the derivation and 0.86 (0.77-0.94) in the validation dataset.
Conclusions: The algorithm demonstrated strong agreement with the participant-clinician consensus, enhancing confidence in CFHealthHub data. Publishingdata processing methods can encourage trust in digital endpoints and serve as an exemplar for other projects.
期刊介绍:
Expert Review of Pharmacoeconomics & Outcomes Research (ISSN 1473-7167) provides expert reviews on cost-benefit and pharmacoeconomic issues relating to the clinical use of drugs and therapeutic approaches. Coverage includes pharmacoeconomics and quality-of-life research, therapeutic outcomes, evidence-based medicine and cost-benefit research. All articles are subject to rigorous peer-review.
The journal adopts the unique Expert Review article format, offering a complete overview of current thinking in a key technology area, research or clinical practice, augmented by the following sections:
Expert Opinion – a personal view of the data presented in the article, a discussion on the developments that are likely to be important in the future, and the avenues of research likely to become exciting as further studies yield more detailed results
Article Highlights – an executive summary of the author’s most critical points.