Anna Jolliff, Richard J Holden, Rupa Valdez, Ryan Coller, Himalaya Patel, Matthew Zuraw, Anna Linden, Aaron Ganci, Christian Elliott, Nicole E Werner
{"title":"Investigating the Best Practices for Engagement in Remote Participatory Design: Mixed Methods Analysis of 4 Remote Studies With Family Caregivers.","authors":"Anna Jolliff, Richard J Holden, Rupa Valdez, Ryan Coller, Himalaya Patel, Matthew Zuraw, Anna Linden, Aaron Ganci, Christian Elliott, Nicole E Werner","doi":"10.2196/60353","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Digital health interventions are a promising method for delivering timely support to underresourced family caregivers. The uptake of digital health interventions among caregivers may be improved by engaging caregivers in participatory design (PD). In recent years, there has been a shift toward conducting PD remotely, which may enable participation by previously hard-to-reach groups. However, little is known regarding how best to facilitate engagement in remote PD among family caregivers.</p><p><strong>Objective: </strong>This study aims to (1) understand the context, quality, and outcomes of family caregivers' engagement experiences in remote PD and (2) learn which aspects of the observed PD approach facilitated engagement or need to be improved.</p><p><strong>Methods: </strong>We analyzed qualitative and quantitative data from evaluation and reflection surveys and interviews completed by research and community partners (family caregivers) across 4 remote PD studies. Studies focused on building digital health interventions for family caregivers. For each study, community partners met with research partners for 4 to 5 design sessions across 6 months. After each session, partners completed an evaluation survey. In 1 of the 4 studies, research and community partners completed a reflection survey and interview. Descriptive statistics were used to summarize quantitative evaluation and reflection survey data, while reflexive thematic analysis was used to understand qualitative data.</p><p><strong>Results: </strong>In 62.9% (83/132) of evaluations across projects 1-3, participants described the session as \"very effective.\" In 74% (28/38) of evaluations for project 4, participants described feeling \"extremely satisfied\" with the session. Qualitative data relating to the engagement context identified that the identities of partners, the technological context of remote PD, and partners' understanding of the project and their role all influenced engagement. Within the domain of engagement quality, relationship-building and co-learning; satisfaction with prework, design activities, time allotted, and the final prototype; and inclusivity and the distribution of influence contributed to partners' experience of engagement. Outcomes of engagement included partners feeling an ongoing interest in the project after its conclusion, gratitude for participation, and a sense of meaning and self-esteem.</p><p><strong>Conclusions: </strong>These results indicate high satisfaction with remote PD processes and few losses specific to remote PD. The results also demonstrate specific ways in which processes can be changed to improve partner engagement and outcomes. Community partners should be involved from study inception in defining the problem to be solved, the approach used, and their roles within the project. Throughout the design process, online tools may be used to check partners' satisfaction with design processes and perceptions of inclusivity and power-sharing. Emphasis should be placed on increasing the psychosocial benefits of engagement (eg, sense of community and purpose) and increasing opportunities to participate in disseminating findings and in future studies.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"26 ","pages":"e60353"},"PeriodicalIF":5.8000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Internet Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2196/60353","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Digital health interventions are a promising method for delivering timely support to underresourced family caregivers. The uptake of digital health interventions among caregivers may be improved by engaging caregivers in participatory design (PD). In recent years, there has been a shift toward conducting PD remotely, which may enable participation by previously hard-to-reach groups. However, little is known regarding how best to facilitate engagement in remote PD among family caregivers.
Objective: This study aims to (1) understand the context, quality, and outcomes of family caregivers' engagement experiences in remote PD and (2) learn which aspects of the observed PD approach facilitated engagement or need to be improved.
Methods: We analyzed qualitative and quantitative data from evaluation and reflection surveys and interviews completed by research and community partners (family caregivers) across 4 remote PD studies. Studies focused on building digital health interventions for family caregivers. For each study, community partners met with research partners for 4 to 5 design sessions across 6 months. After each session, partners completed an evaluation survey. In 1 of the 4 studies, research and community partners completed a reflection survey and interview. Descriptive statistics were used to summarize quantitative evaluation and reflection survey data, while reflexive thematic analysis was used to understand qualitative data.
Results: In 62.9% (83/132) of evaluations across projects 1-3, participants described the session as "very effective." In 74% (28/38) of evaluations for project 4, participants described feeling "extremely satisfied" with the session. Qualitative data relating to the engagement context identified that the identities of partners, the technological context of remote PD, and partners' understanding of the project and their role all influenced engagement. Within the domain of engagement quality, relationship-building and co-learning; satisfaction with prework, design activities, time allotted, and the final prototype; and inclusivity and the distribution of influence contributed to partners' experience of engagement. Outcomes of engagement included partners feeling an ongoing interest in the project after its conclusion, gratitude for participation, and a sense of meaning and self-esteem.
Conclusions: These results indicate high satisfaction with remote PD processes and few losses specific to remote PD. The results also demonstrate specific ways in which processes can be changed to improve partner engagement and outcomes. Community partners should be involved from study inception in defining the problem to be solved, the approach used, and their roles within the project. Throughout the design process, online tools may be used to check partners' satisfaction with design processes and perceptions of inclusivity and power-sharing. Emphasis should be placed on increasing the psychosocial benefits of engagement (eg, sense of community and purpose) and increasing opportunities to participate in disseminating findings and in future studies.
期刊介绍:
The Journal of Medical Internet Research (JMIR) is a highly respected publication in the field of health informatics and health services. With a founding date in 1999, JMIR has been a pioneer in the field for over two decades.
As a leader in the industry, the journal focuses on digital health, data science, health informatics, and emerging technologies for health, medicine, and biomedical research. It is recognized as a top publication in these disciplines, ranking in the first quartile (Q1) by Impact Factor.
Notably, JMIR holds the prestigious position of being ranked #1 on Google Scholar within the "Medical Informatics" discipline.