{"title":"Barriers and Facilitators to User Engagement and Moderation for Web-Based Peer Support Among Young People: Qualitative Study Using the Behavior Change Wheel Framework.","authors":"Ananya Ananya, Janina Tuuli, Rachel Perowne, Leslie Morrison Gutman","doi":"10.2196/64097","DOIUrl":"10.2196/64097","url":null,"abstract":"<p><strong>Background: </strong>Peer support groups or web-based chats for young people offer anonymous peer support in judgment-free spaces, where users may share their thoughts and feelings with others who may have experienced similar situations. User engagement is crucial for effective web-based peer support; however, levels of engagement vary. While moderation of peer support groups can have a positive impact on the engagement of young people, effective moderation can be challenging to implement.</p><p><strong>Objective: </strong>This study aimed to identify barriers and facilitators to user engagement with, and moderation of, web-based peer support groups among young people aged 16 to 25 years and to provide recommendations for enhancing this service.</p><p><strong>Methods: </strong>Drawing upon the Theoretical Domains Framework (TDF) and the Behavior Change Wheel (BCW), this study conducted qualitative interviews and gathered open-ended questionnaires from service users and moderators of The Mix, the United Kingdom's leading web-based mental health platform providing peer support groups for young people. Semistructured interviews were conducted with 2 service users and 8 moderators, and open-ended questionnaires were completed by 7 service users. Themes were coded using the Capability, Opportunity, Motivation, and Behavior (COM-B) model and the TDF. The BCW tools were then used to identify relevant behavior change techniques to improve user engagement in, and moderation of, the service.</p><p><strong>Results: </strong>Thematic analysis revealed a total of 20 inductive themes within 10 TDF domains-9 (45%) for engagement and 11 (55%) for moderation. Of these 20 themes, 3 (15%) were facilitators of engagement, 7 (35%) were facilitators of moderation, 4 (20%) were barriers to moderation, and 6 (30%) barriers to engagement. Results suggest that skills, knowledge, beliefs about consequences, intentions, emotions, and the social and physical environment are important factors influencing service users and moderators of group chats. In particular, supporting the improvement of memory, attention, and decision-making skills of those involved; adapting the physical environment to facilitate effective interactions; and reducing negative emotions are suggested to optimize the value and effectiveness of peer support groups for young people's mental health for both the service users and moderators of these services.</p><p><strong>Conclusions: </strong>The study demonstrates the effectiveness of the BCW approach and the use of the TDF and COM-B model to understand the influences on behavior in a systematic manner, especially for mental health and well-being interventions. The findings can be applied to design structured interventions to change behaviors related to the engagement with, and moderation of, web-based peer support groups and, in turn, improve mental health outcomes for young people.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e64097"},"PeriodicalIF":2.6,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11840382/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143256926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring User Experience and the Therapeutic Relationship of Short-Term Avatar-Based Psychotherapy: Qualitative Pilot Study.","authors":"Byeul Jang, Chisung Yuh, Hyeri Lee, Yu-Bin Shin, Heon-Jeong Lee, Eun Kyoung Kang, Jeongyun Heo, Chul-Hyun Cho","doi":"10.2196/66158","DOIUrl":"10.2196/66158","url":null,"abstract":"<p><strong>Background: </strong>The rapid advancement of telehealth has led to the emergence of avatar-based psychotherapy (ABP), which combines the benefits of anonymity with nonverbal communication. With the adoption of remote mental health services, understanding the efficacy and user experience of ABP has become increasingly important.</p><p><strong>Objective: </strong>This study aimed to explore the user experience and therapeutic relationship formation in short-term ABP environments, focusing on psychological effects, user satisfaction, and critical factors for implementation.</p><p><strong>Methods: </strong>This qualitative study involved 18 adult participants (8 women and 10 men). Participants engaged in two short-term ABP sessions (approximately 50 minutes per session) over 2 weeks, using an ABP metaverse system prototype. Semistructured in-depth interviews were conducted with both the participants and therapists before and after the ABP sessions. The interviews were conducted via an online platform, with each interview lasting approximately 30 minutes. The key topics included the sense of intimacy, communication effectiveness of avatar expressions, emotions toward one's avatar, concentration during sessions, and perceived important aspects of the ABP. Data were analyzed using thematic analysis.</p><p><strong>Results: </strong>The analysis revealed 3 main themes with 8 subthemes: (1) reduction of psychological barriers through avatar use (subthemes: anonymity, ease of access, self-objectification, and potential for self-disclosure); (2) importance of the avatar-self-connection in therapeutic relationship formation (subthemes: avatar self-relevance and avatar-self-connection fostering intimacy and trust); and (3) importance of nonverbal communication (subthemes: significance of nonverbal expressions and formation of empathy and trust through nonverbal expressions). Participants reported enhanced comfort and self-disclosure owing to the anonymity provided by avatars, while emphasizing the importance of avatar customization and the role of nonverbal cues in facilitating communication and building rapport.</p><p><strong>Conclusions: </strong>This pilot study provides valuable insights into the short-term ABP user experience and therapeutic relationship formation. Our findings suggest that ABP has the potential to reduce barriers to therapy through anonymity, ease of access, and potential for self-disclosure, while allowing for meaningful nonverbal communication. The avatar-self-connection emerged as a crucial factor in the effectiveness of ABP, highlighting the importance of avatar customization in enhancing user engagement and therapeutic outcomes. Future research and development in ABP should focus on improving avatar customization options, enhancing the fidelity of nonverbal cues, and investigating the long-term effectiveness of ABP compared with traditional face-to-face therapy.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e66158"},"PeriodicalIF":2.6,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11830452/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143383834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Drashko Nakikj, David Kreda, Karan Luthria, Nils Gehlenborg
{"title":"Patient-Generated Collections for Organizing Electronic Health Record Data to Elevate Personal Meaning, Improve Actionability, and Support Patient-Health Care Provider Communication: Think-Aloud Evaluation Study.","authors":"Drashko Nakikj, David Kreda, Karan Luthria, Nils Gehlenborg","doi":"10.2196/50331","DOIUrl":"10.2196/50331","url":null,"abstract":"<p><strong>Background: </strong>Through third party applications, patients in the United States have access to their electronic health record (EHR) data from multiple health care providers. However, these applications offer only a predefined organization of these records by type, time stamp, or provider, leaving out meaningful connections between them. This prevents patients from efficiently reviewing, exploring, and making sense of their EHR data based on current or ongoing health issues. The lack of personalized organization and important connections can limit patients' ability to use their data and make informed health decisions.</p><p><strong>Objective: </strong>To address these challenges, we created Discovery, an experimental app that enables patients to organize their medical records into collections, analogous to placing pictures in photo albums. These collections are based on the evolving understanding of the patients' past and ongoing health issues. The app also allows patients to add text notes to collections and their constituent records. By observing how patients used features to select records and assemble them into collections, our goal was to learn about their preferred mechanisms to complete these tasks and the challenges they would face in the wild. We also intended to become more informed about the various ways in which patients could and would like to use collections.</p><p><strong>Methods: </strong>We conducted a think-aloud evaluation study with 14 participants on synthetic data. In session 1, we obtained feedback on the mechanics for creating and assembling collections and adding notes. In session 2, we focused on reviewing collections, finding data patterns within them, and retaining insights, as well as exploring use cases. We conducted reflexive thematic analysis on the transcribed feedback.</p><p><strong>Results: </strong>Collections were useful for personal use (quick access to information, reflection on medical history, tracking health, journaling, and learning from past experiences) and clinical visits (preparation and raising physicians' awareness). Assembling EHR data into reliable collections could be difficult for typical patients due to considerable manual work and lack of medical knowledge. However, automated collection building could alleviate this issue. Furthermore, having EHR data organized in collections may have limited use. However, augmenting them with patient-generated data, which are entered with flexible richness and structure, could add context, elevate meaning, and improve actionability. Finally, collections might produce a misconstrued health picture, but bringing the physician in the loop for verification could increase their clinical validity.</p><p><strong>Conclusions: </strong>Collections can be a powerful tool for advancing patients' proactivity, awareness, and self-advocacy, potentially facilitating patient-centered care. However, patients need better support for incorporating their own ever","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e50331"},"PeriodicalIF":2.6,"publicationDate":"2025-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11833264/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143123812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Collecting Real-World Data via an In-Home Smart Medication Dispenser: Longitudinal Observational Study of Survey Panel Persistency, Response Rates, and Psychometric Properties.","authors":"Benjamin Ogorek, Thomas Rhoads, Erica Smith","doi":"10.2196/60438","DOIUrl":"10.2196/60438","url":null,"abstract":"<p><strong>Background: </strong>A smart medication dispenser called \"spencer\" is a novel generator of longitudinal survey data. The patients dispensing medication act as a survey panel and respond to questions about quality of life and patient-reported outcomes.</p><p><strong>Objectives: </strong>Our goal was to evaluate panel persistency, survey response rates, reliability, and validity of surveys administered via spencer to 4138 polychronic patients residing in the United States and Canada.</p><p><strong>Methods: </strong>Patients in a Canadian health care provider's program were included if they were dispensing via spencer in the June 2021 to February 2024 time frame and consented to have their data used for research. Panel persistency was estimated via discrete survival methods for 2 years and survey response rates were computed for 1 year. Patients were grouped by mean response rates in the 12th month (<90% vs ≥90%) to observe differential response rate trends. For reliability and validity, we used a spencer question about recent falls with ternary responses value-coded -1, 0, and 1. For reliability, we computed Pearson correlation between mean scores over 2 years of survey responses, and transitions between mean score intervals of [0, 0.5), [-0.5, 0.5), and [0.5, 1]. For validity, we measured the association between the falls question and known factors influencing fall risk: age, biological sex, quality of life, physical and emotional health, and use of selective serotonin reuptake inhibitors or serotonin-norepinephrine reuptake inhibitors, using repeated-measures regression for covariates and Kendall τ for concomitant spencer questions.</p><p><strong>Unlabelled: </strong>From 4138 patients, dispenser persistency was 68.3% (95% CI 66.8%-69.8%) at 1 year and 51% (95% CI 49%-53%) at 2 years. Within the cohort observed beyond 1 year, 82.3% (1508/1832) kept surveys enabled through the 12th month with a mean response rate of 84.1% (SD 26.4%). The large SD was apparent in the subgroup analysis, where a responder versus nonresponder dichotomy was observed. For 234 patients with ≥5 fall risk responses in each of the first 2 years, the Pearson correlation estimate between yearly mean scores was 0.723 (95% CI 0.630-0.798). For mean score intervals [0, 0.5), [-0.5, 0.5), and [0.5, 1], self-transitions were the most common, with 59.8% (140/234) of patients starting and staying in [0.5, 1]. Fall risk responses were not significantly associated with sex (P=.66) or age (P=.76) but significantly related to selective serotonin reuptake inhibitor or serotonin-norepinephrine reuptake inhibitor usage, quality of life, depressive symptoms, physical health, disability, and trips to the emergency room (P<.001).</p><p><strong>Conclusions: </strong>A smart medication dispenser, spencer, generated years of longitudinal survey data from patients in their homes. Panel attrition was low, and patients continued to respond at high rates. A fall risk measure derived from ","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e60438"},"PeriodicalIF":2.6,"publicationDate":"2025-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11809940/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143123810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Birgitte Berentsen, Camilla Thuen, Eline Margrete Randulff Hillestad, Elisabeth Kjelsvik Steinsvik, Trygve Hausken, Jan Gunnar Hatlebakk
{"title":"The Effects of Digital eHealth Versus Onsite 2-Day Group-Based Education in 255 Patients With Irritable Bowel Syndrome: Cohort Study.","authors":"Birgitte Berentsen, Camilla Thuen, Eline Margrete Randulff Hillestad, Elisabeth Kjelsvik Steinsvik, Trygve Hausken, Jan Gunnar Hatlebakk","doi":"10.2196/43618","DOIUrl":"10.2196/43618","url":null,"abstract":"<p><strong>Background: </strong>Irritable bowel syndrome (IBS) has a high worldwide prevalence and there are few effective treatment options. Patient education can influence patient behavior that subsequently may lead to changes in attitudes and skills necessary for maintenance or improvement in management of symptom severity and quality of life. However, as postdiagnostic patient education can be resource demanding, assessment of digital approaches and verification of their effectiveness is warranted.</p><p><strong>Objective: </strong>This cohort study aimed to investigate the effects of a digital web-based multidisciplinary eHealth program on the domains of symptom severity (Irritable Bowel Syndrome Symptom Severity Scale [IBS-SSS]), quality of life (irritable bowel syndrome quality of life [IBS-QOL]), anxiety and depression (Hospital Anxiety and Depression Scale), and a measure of general client satisfaction (client satisfaction questionnaire), compared with an onsite multidisciplinary 2-day group-based education program (\"IBS-school\"), in 2 cohorts of 255 patients with IBS.</p><p><strong>Methods: </strong>Patients diagnosed with IBS, aged 15-70 years, were enrolled after referral to the Section of Gastroenterology at Haukeland University Hospital, Norway. In total, 132 patients were recruited to the eHealth program and 123 to the IBS-school group for comparison. Data were self-reported and collected digitally at enrollment and after 3 months, between 2017 and 2019. Furthermore, 71 attending the eHealth program and 49 attending the IBS-school completed the questionnaires at 3 months. Intervention response was defined as a reduction of ≥50 points on the IBS-SSS.</p><p><strong>Results: </strong>Patients attending the eHealth program reported a significant reduction in IBS symptom severity 3 months after treatment (n=71), compared with patients attending the IBS-school (n=50). Overall, patients categorized as intervention responders in both programs showed a significant reduction in symptom severity at 3 months. Here, 41% (29/71) of patients attending the eHealth program reported a mean IBS-SSS reduction of 103 (SD 72.0) points (P<.001). In addition, these patients reported reduced anxiety (P>.001) and depression (P=.002) and enhanced quality of life (P=.03), especially the degrees of dysphoria, body image, food avoidance, health worry, interference with activity, relations, and social relations. Patients responding to the IBS-school intervention (18/50, 36%) reported a mean IBS-SSS reduction of 119 (SD 86.2) points (P<.001), and reduced depression scores (P=.046), but no difference in overall quality of life. Both groups reported the respective interventions as \"good\" quality health care programs, scoring them 23.5 (SD 4)-the eHealth program 23.5 (SD 4), and the IBS-school 24.2 (SD 4)-on the client satisfaction questionnaire.</p><p><strong>Conclusions: </strong>We conclude that the digital multidisciplinary eHealth program has a significant effe","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e43618"},"PeriodicalIF":2.6,"publicationDate":"2025-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11809937/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143123816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Johanna Tjernberg, Sara Helgesson, Anders Håkansson, Helena Hansson
{"title":"Exploring the Users' Perspective of the Nationwide Self-Exclusion Service for Gambling Disorder, \"Spelpaus\": Qualitative Interview Study.","authors":"Johanna Tjernberg, Sara Helgesson, Anders Håkansson, Helena Hansson","doi":"10.2196/66045","DOIUrl":"10.2196/66045","url":null,"abstract":"<p><strong>Background: </strong>Problem gambling and gambling disorder cause severe social, psychiatric, and financial consequences, and voluntary self-exclusion is a common harm reduction tool used by individuals with gambling problems.</p><p><strong>Objective: </strong>The aim of this study was to explore users' experience of a novel nationwide, multioperator gambling self-exclusion service, \"Spelpaus,\" in Sweden and to inform stakeholders and policy makers in order to improve harm reduction tools against gambling problems.</p><p><strong>Methods: </strong>Semistructured interviews were conducted with 15 individuals who reported self-perceived gambling problems and who had experience of having used the self-exclusion service Spelpaus in Sweden. Interviews were transcribed and analyzed through qualitative content analysis.</p><p><strong>Results: </strong>We identified 3 categories and 8 subcategories. The categories were (1) reasons for the decision to self-exclude, (2) positive experiences, and (3) suggestions for improvement. The subcategories identified a number of reasons for self-exclusion, such as financial reasons and family reasons, and positive experiences described as a relief from gambling; in addition, important suggestions for improvement were cited, such as a more gradual return to gambling post-self-exclusion, better ways to address loopholes in the system, and transfer from self-exclusion to treatment.</p><p><strong>Conclusions: </strong>Voluntary self-exclusion from gambling, using a nationwide multioperator service, remains an appreciated harm-reducing tool. However, transfer from self-exclusion to treatment should be facilitated by policy making, and loopholes allowing for breaching of the self-exclusion need to be counteracted.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e66045"},"PeriodicalIF":2.6,"publicationDate":"2025-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11829171/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143068180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haneen Amhaz, Sally Xuanping Chen, Amanee Elchehimi, Kylin Jialin Han, Jade Morales Gil, Lu Yao, Marianne Vidler, Kathryn Berry-Einarson, Kathryn Dewar, May Tuason, Nicole Prestley, Quynh Doan, Tibor van Rooij, Tina Costa, Gina Ogilvie, Beth A Payne
{"title":"The Research Agenda for Perinatal Innovation and Digital Health Project: Human-Centered Approach to Multipartner Research Agenda Codevelopment.","authors":"Haneen Amhaz, Sally Xuanping Chen, Amanee Elchehimi, Kylin Jialin Han, Jade Morales Gil, Lu Yao, Marianne Vidler, Kathryn Berry-Einarson, Kathryn Dewar, May Tuason, Nicole Prestley, Quynh Doan, Tibor van Rooij, Tina Costa, Gina Ogilvie, Beth A Payne","doi":"10.2196/60825","DOIUrl":"10.2196/60825","url":null,"abstract":"<p><strong>Background: </strong>Digital health innovations provide an opportunity to improve access to care, information, and quality of care during the perinatal period, a critical period of health for mothers and infants. However, research to develop perinatal digital health solutions needs to be informed by actual patient and health system needs in order to optimize implementation, adoption, and sustainability.</p><p><strong>Objective: </strong>Our aim was to co-design a research agenda with defined research priorities that reflected health system realities and patient needs.</p><p><strong>Methods: </strong>Co-design of the research agenda involved a series of activities: (1) review of the provincial Digital Health Strategy and Maternity Services Strategy to identify relevant health system priorities, (2) anonymous survey targeting perinatal care providers to ascertain their current use and perceived need for digital tools, (3) engagement meetings using human-centered design methods with multilingual patients who are currently or recently pregnant to understand their health experiences and needs, and (4) a workshop that brought together patients and other project partners to prioritize identified challenges and opportunities for perinatal digital health in a set of research questions. These questions were grouped into themes using a deductive analysis approach starting with current BC Digital Health Strategy guiding principles.</p><p><strong>Results: </strong>Between September 15, 2022, and August 31, 2023, we engaged with more than 150 perinatal health care providers, researchers, and health system stakeholders and a patient advisory group of women who were recently pregnant to understand the perceived needs and priorities for digital innovation in perinatal care in British Columbia, Canada. As a combined group, partners were able to define 12 priority research questions in 3 themes. The themes prioritized are digital innovation for (1) patient autonomy and support, (2) standardized educational resources for patients and providers, and (3) improved access to health information.</p><p><strong>Conclusions: </strong>Our research agenda highlights the needs for perinatal digital health research to support improvements in the quality of care in British Columbia. By using a human-centered design approach, we were able to co-design research priorities that are meaningful to patients and health system stakeholders. The identified priority research questions are merely a stepping stone in the research process and now need to be actioned by research teams and health systems partners.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e60825"},"PeriodicalIF":2.6,"publicationDate":"2025-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11826941/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143068166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluating the Development, Reliability, and Validation of the Tele-Primary Care Oral Health Clinical Information System Questionnaire: Cross-Sectional Questionnaire Study.","authors":"Rosnah Sutan, Shahida Ismail, Roszita Ibrahim","doi":"10.2196/53630","DOIUrl":"10.2196/53630","url":null,"abstract":"<p><strong>Background: </strong>Evaluating digital health service delivery in primary health care requires a validated questionnaire to comprehensively assess users' ability to implement tasks customized to the program's needs.</p><p><strong>Objective: </strong>This study aimed to develop, test the reliability of, and validate the Tele-Primary Care Oral Health Clinical Information System (TPC-OHCIS) questionnaire for evaluating the implementation of maternal and child digital health information systems.</p><p><strong>Methods: </strong>A cross-sectional study was conducted in 2 phases. The first phase focused on content item development and was validated by a group of 10 experts using the content validity index. The second phase was to assess its psychometric testing for reliability and validity.</p><p><strong>Results: </strong>A structured questionnaire of 65 items was constructed to assess the TPC-OHCIS delivery for primary health care use based on literature and has been validated by 10 experts, and 319 respondents answered the 65-item TPC-OHCIS questionnaire, with mean item scores ranging from 1.99 (SD 0.67) to 2.85 (SD 1.019). The content validity, reliability, and face validity showed a scale-level content validity index of 0.90, scale-level content validation ratio of 0.90, and item-level face validity index of 0.76, respectively. The internal reliability was calculated as a Cronbach α value of 0.90, with an intraclass correlation coefficient of 0.91. Scales were determined by the scree plot with eigenvalues >1, and 13 subscales were identified based on principal component analysis. The Kaiser-Meyer-Olkin value was 0.90 (P<.049). The total variance explained was 76.07%, and factor loading scores for all variables were >0.7. The Bartlett test of sphericity, determining construct validity, was found to be significant (P<.049).</p><p><strong>Conclusions: </strong>The TPC-OHCIS questionnaire is valid to be used at the primary health care level to evaluate the TPC-OHCIS implementation. It can assess health care workers' work performance and job acceptance and improve the quality of care.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e53630"},"PeriodicalIF":2.6,"publicationDate":"2025-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11822314/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143068174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ann Marie Mazzella-Ebstein, Robert Daly, Jennie Huang, Camila Bernal, Clare Wilhelm, Katherine S Panageas, Jessie Holland, Rori Salvaggio, Jill Ackerman, Jennifer Cracchiolo, Gilad Kuperman, Jun Mao, Aaron Begue, Margaret Barton-Burke
{"title":"Oncology Clinicians' Perspectives of a Remote Patient Monitoring Program: Multi-Modal Case Study Approach.","authors":"Ann Marie Mazzella-Ebstein, Robert Daly, Jennie Huang, Camila Bernal, Clare Wilhelm, Katherine S Panageas, Jessie Holland, Rori Salvaggio, Jill Ackerman, Jennifer Cracchiolo, Gilad Kuperman, Jun Mao, Aaron Begue, Margaret Barton-Burke","doi":"10.2196/60585","DOIUrl":"10.2196/60585","url":null,"abstract":"<p><strong>Background: </strong>Remote patient monitoring (RPM) aims to improve patient access to care and communication with clinical providers. Overall, understanding the usability of RPM applications and their influence on clinical care workflows is limited from the perspectives of clinician end users at a cancer center in the Northeastern United States.</p><p><strong>Objective: </strong>This study aims to explore the usability and functionality of RPM and elicit the perceptions and experiences of oncology clinicians using RPM for oncology patients after hospital discharge.</p><p><strong>Methods: </strong>The sample included 30 of 98 clinicians (31% response rate) managing at least 5 patients in the RPM program and responding to the mHealth usability between March 2021 and October 2021. Overall, clinicians responded positively to the survey. Item responses with the highest proportion of disagreement were explored further. A nested sample of 5 clinicians who responded to the study survey (30% response rate) participated in interview sessions conducted from November 2021 to February 2022, averaging 60 minutes each.</p><p><strong>Results: </strong>Survey responses highlighted that RPM was easy to use and learn and verified symptom alerts during follow-up phone calls. Areas to improve identified practice changes from reporting RPM alerts through digital portals and its influence on clinicians' workload burden. Interview sessions revealed 3 main themes: clinician understanding and usability constraints, patient constraints, and suggestions for improving the program. Subthemes for each theme were explored, characterizing technical and functional limitations that could be addressed to enhance efficiency, workflow, and user experience.</p><p><strong>Conclusions: </strong>Clinicians support the value of RPM for improving symptom management and engaging with providers. Improvements to address RPM challenges include functional changes to enhance the program's utility, such as input from patients about temporal changes in their symptoms and technical resources for home monitoring devices.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e60585"},"PeriodicalIF":2.6,"publicationDate":"2025-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11811663/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143047985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lisa Specht, Raphael Scheible, Martin Boeker, Erik Farin-Glattacker, Nikolas Kampel, Marina Schmölz, Andrea Schöpf-Lazzarino, Stefan Schulz, Christian Schlett, Fabian Thomczyk, Sebastian Voigt-Radloff, Constanze Wegner, Katharina Wollmann, Andy Maun
{"title":"Evaluating the Acceptance and Usability of an Independent, Noncommercial Search Engine for Medical Information: Cross-Sectional Questionnaire Study and User Behavior Tracking Analysis.","authors":"Lisa Specht, Raphael Scheible, Martin Boeker, Erik Farin-Glattacker, Nikolas Kampel, Marina Schmölz, Andrea Schöpf-Lazzarino, Stefan Schulz, Christian Schlett, Fabian Thomczyk, Sebastian Voigt-Radloff, Constanze Wegner, Katharina Wollmann, Andy Maun","doi":"10.2196/56941","DOIUrl":"10.2196/56941","url":null,"abstract":"<p><strong>Background: </strong>The internet is a key source of health information, but the quality of content from popular search engines varies, posing challenges for users-especially those with low health or digital health literacy. To address this, the \"tala-med\" search engine was developed in 2020 to provide access to high-quality, evidence-based content. It prioritizes German health websites based on trustworthiness, recency, user-friendliness, and comprehensibility, offering category-based filters while ensuring privacy by avoiding data collection and advertisements.</p><p><strong>Objective: </strong>This study aims to evaluate the acceptance and usability of this independent, noncommercial search engine from the users' perspectives and their actual use of the search engine.</p><p><strong>Methods: </strong>For the questionnaire study, a cross-sectional study design was used. In total, 802 participants were recruited through a web-based panel and were asked to interact with the new search engine before completing a web-based questionnaire. Descriptive statistics and multiple regression analyses were used to assess participants' acceptance and usability ratings, as well as predictors of acceptance. Furthermore, from October 2020 to June 2021, we used the open-source web analytics platform Matomo to collect behavior-tracking data from consenting users of the search engine.</p><p><strong>Results: </strong>The study indicated positive findings on the acceptance and usability of the search engine, with more than half of the participants willing to reuse (465/802, 58%) and recommend it (507/802, 63.2%). Of the 802 users, 747 (93.1%) valued the absence of advertising. Furthermore, 92.3% (518/561), 93.9% (553/589), 94.7% (567/599), and 96.5% (600/622) of those users who used the filters agreed at least partially that the filter functions were helpful in finding trustworthy, recent, user-friendly, or comprehensible results. Participants criticized some of the search results regarding the selection of domains and shared ideas for potential improvements (eg, for a clearer design). Regression analyses showed that the search engine was especially well accepted among older users, frequent internet users, and those with lower educational levels, indicating an effective targeting of segments of the population with lower health literacy and digital health literacy. Tracking data analysis revealed 1631 sessions, comprising 3090 searches across 1984 unique terms. Users performed 1.64 (SD 1.31) searches per visit on average. They prioritized the search terms \"corona,\" \"back pain,\" and \"cough.\" Filter changes were common, especially for recency and trustworthiness, reflecting the importance that users placed on these criteria.</p><p><strong>Conclusions: </strong>User questionnaires and behavior tracking showed the platform was well received, particularly by older and less educated users, especially for its advertisement-free design and filtering system. While f","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"12 ","pages":"e56941"},"PeriodicalIF":2.6,"publicationDate":"2025-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11803324/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143030011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}