David H Gustafson, David H Gustafson, Marie-Louise Mares, Darcie C Johnston, Olivia J Vjorn, John J Curtin, Elizabeth E Epstein, Genie L Bailey
{"title":"Couple-Focused Smartphone Intervention to Reduce Problem Drinking: Pilot Randomized Control Trial.","authors":"David H Gustafson, David H Gustafson, Marie-Louise Mares, Darcie C Johnston, Olivia J Vjorn, John J Curtin, Elizabeth E Epstein, Genie L Bailey","doi":"10.2196/58622","DOIUrl":"https://doi.org/10.2196/58622","url":null,"abstract":"<p><strong>Background: </strong>Alcohol use disorder is among the most pervasive substance use disorders in the United States, with a lifetime prevalence of 30%. Recommended treatment options include evidence-based behavioral interventions; smartphone-based interventions confer a number of benefits such as portability, continuous access, and stigma avoidance; and research suggests that interventions involving couples may outperform those for patients only. In this context, a behavioral intervention delivered to couples through smartphones may serve as an effective adjunct to alcohol use disorder treatment.</p><p><strong>Objective: </strong>This pilot study aimed to (1) evaluate the feasibility of comparing a patient-only (Addiction version of the Comprehensive Health Enhancement Support System; A-CHESS) versus a couple-focused (Partner version of the Comprehensive Health Enhancement Support System; Partner-CHESS) eHealth app for alcohol misuse delivered by smartphone, (2) assess perceptions about and use of the 2 apps, and (3) examine initial indications of differences in primary clinical outcomes between patient groups using the 2 apps. Broadly, these aims serve to assess the feasibility of the study protocol for a larger randomized controlled trial.</p><p><strong>Methods: </strong>A total of 33 romantic couples were randomized to 6 months of A-CHESS app use (active treatment control) or Partner-CHESS app use (experimental). Couples comprised a patient with current alcohol use disorder (25/33, 76% male) and a romantic partner (26/33, 79% female). Patients and partners in both arms completed outcome measure surveys at 0, 2, 4, and 6 months. Primary outcomes were patients' percentage of days with heavy drinking and percentage of days with any drinking, measured by timeline follow back. Secondary outcomes included app use and perceptions, and multiple psychosocial variables.</p><p><strong>Results: </strong>At 6 months, 78% (14/18) of Partner-CHESS patients and 73% (11/15) of A-CHESS patients were still using the intervention. The apps were rated helpful on a 5-point scale (1=not at all helpful, 5=extremely helpful) by 89% (29/33) of both Partner-CHESS patients (mean 3.7, SD 1) and partners (mean 3.6, SD 0.9) and by 87% (13/15) of A-CHESS patients (mean 3.1, SD 0.9). At 6 months, Partner-CHESS patients had a nonsignificantly lower percentage of days with heavy drinking compared with A-CHESS patients (β=-17.4, 95% CI -36.1 to 1.4; P=.07; Hedges g=-0.53), while the percentage of drinking days was relatively equal between patient groups (β=-2.1, 95% CI -24.8 to 20.7; P=.85; Hedges g=-0.12).</p><p><strong>Conclusions: </strong>Initial results support the feasibility of evaluating patient-only and couple-focused, smartphone-based interventions for alcohol misuse. Results suggest that both interventions are perceived as helpful and indicate maintained engagement of most participants for 6 months. A future, fully powered trial is warranted to evaluate the ","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142562399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maximilian Wegener, Katarzyna Sims, Ralph Brooks, Lisa Nichols, Robert Sideleau, Sharen McKay, Merceditas Villanueva
{"title":"Understanding Users' Engagement in a Provider-Created Mobile App for Training to Advance Hepatitis C Care: Knowledge Assessment Survey Study.","authors":"Maximilian Wegener, Katarzyna Sims, Ralph Brooks, Lisa Nichols, Robert Sideleau, Sharen McKay, Merceditas Villanueva","doi":"10.2196/52729","DOIUrl":"https://doi.org/10.2196/52729","url":null,"abstract":"<p><strong>Background: </strong>The World Health Organization and the Centers for Disease Control and Prevention have set ambitious hepatitis C virus (HCV) elimination targets for 2030. Current estimates show that the United States is not on pace to meet elimination targets due to multiple patient, clinic, institutional, and societal level barriers that contribute to HCV testing and treatment gaps. Among these barriers are unawareness of testing and treatment needs, misinformation concerning adverse treatment reactions, need for substance use sobriety, and treatment efficacy. Strategies to improve viral hepatitis education are needed.</p><p><strong>Objective: </strong>We aim to provide a high-quality HCV educational app for patients and health care workers, particularly nonprescriber staff. The app was vetted by health care providers and designed to guide users through the HCV testing and treatment stages in a self-exploratory way to promote engagement and knowledge retention. The app is comprised of five learning modules: (1) Testing for Hep C (hepatitis C), (2) Tests for Hep C Positive Patients, (3) Treatments Available to You, (4) What to Expect During Treatment, and (5) What to Expect After Treatment.</p><p><strong>Methods: </strong>An HCV knowledge assessment survey was administered to providers and patients at the Yale School of Medicine and 11 Connecticut HIV clinics as part of a grant-funded activity. The survey findings and pilot testing feedback guided the app's design and content development. Data on app usage from November 2019 to November 2022 were analyzed, focusing on user demographics, engagement metrics, and module usage patterns.</p><p><strong>Results: </strong>There were 561 app users; 216 (38.5%) accessed the training modules of which 151 (69.9%) used the app for up to 60 minutes. Of them, 65 (30.1%) users used it for >60 minutes with a median time spent of 5 (IQR 2-8) minutes; the median time between initial accession and last use was 39 (IQR 18-60) days. Users accessed one or more modules and followed a nonsequential pattern of use: module 1: 163 (75.4%) users; module 4: 82 (38%); module 5: 67 (31%); module 3: 49 (22.7%); module 2: 41 (19%).</p><p><strong>Conclusions: </strong>This app, created in an academic setting, is one of a few available in English and Spanish that provides content-vetted HCV education for patients and health care supportive staff. It offers the convenience of on-demand education, allowing users to access crucial information about HCV management and treatment in a self-directed fashion that acknowledges and promotes variable preferences in learning approaches. While app uptake was relatively limited, we propose that future efforts should focus on combined promotion efforts with marketing strategies experts aligned with academic experts. Incorporating ongoing user feedback and integrating personalized reminders and quizzes, will further enhance engagement, supporting the broader public health HCV elimin","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142562403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Katherine C Paltell, Jennifer Duffecy, Pauline M Maki, Shiva Edalatian Zakeri, Anka A Vujanovic, Erin C Berenz
{"title":"Web-Based Intervention (SunnysideFlex) to Promote Resilience to Posttraumatic Stress Disorder Symptoms During Pregnancy: Development and Pilot Study.","authors":"Katherine C Paltell, Jennifer Duffecy, Pauline M Maki, Shiva Edalatian Zakeri, Anka A Vujanovic, Erin C Berenz","doi":"10.2196/53744","DOIUrl":"10.2196/53744","url":null,"abstract":"<p><strong>Background: </strong>Approximately 4% to 8% of pregnant individuals meet the criteria for current posttraumatic stress disorder (PTSD), a known risk factor for a multitude of adverse maternal and child health outcomes. However, PTSD is rarely detected or treated in obstetric settings. Moreover, available prenatal PTSD treatments require in-person services that are often inaccessible due to barriers to care. Thus, web-based interventions offer great potential in extending PTSD treatment to high-risk pregnant individuals by providing affordable, accessible care. However, there are currently no web-based interventions designed specifically for the treatment of PTSD symptoms during pregnancy.</p><p><strong>Objective: </strong>This study aims to develop and pilot a 6-week, web-based, cognitive behavioral therapy intervention for PTSD, SunnysideFlex, in a sample of 10 pregnant women with current probable PTSD. Consistent with established guidelines for developing and testing novel interventions, the focus of this pilot study was to evaluate the initial feasibility and acceptability of the SunnysideFlex intervention and preintervention to postintervention changes in PTSD and depression symptoms. This approach will allow for early refinement and optimization of the SunnysideFlex intervention to increase the odds of success in a larger-scale clinical trial.</p><p><strong>Methods: </strong>The SunnysideFlex intervention adapted an existing web-based platform for postpartum depression, Sunnyside for Moms, to include revised, trauma-focused content. A total of 10 pregnant women in weeks 16 to 28 of their pregnancy who reported lifetime interpersonal trauma exposure (ie, sexual or physical assault) and with current probable PTSD (scores ≥33 per the PTSD checklist for DSM-5) were enrolled in the SunnysideFlex intervention. Assessments took place at baseline and 6 weeks (postintervention).</p><p><strong>Results: </strong>All participants were retained through the postintervention assessment period. Engagement was high; participants on average accessed 90% of their lessons, logged on to the platform at least weekly, and reported a generally positive user experience. Moreover, 80% (8/10) of participants demonstrated clinically meaningful reductions in PTSD symptoms from baseline to postintervention, and 50% (5/10) of participants no longer screened positive for probable PTSD at postintervention. Most (6/10, 60%) of the participants maintained subclinical depression symptoms from baseline to postintervention.</p><p><strong>Conclusions: </strong>Findings from this small pilot study indicate that SunnysideFlex may be a feasible and acceptable mechanism for delivering PTSD intervention to high-risk, trauma-exposed pregnant women who might otherwise not have opportunities for services. Larger-scale trials of the intervention are necessary to better understand the impact of SunnysideFlex on PTSD symptoms during pregnancy and the postpartum period.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142557878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ana Ramirez, Justin Kramer, Katrina Hazim, Jason Roberge
{"title":"Digital Youth and Family Engagement Program for Adolescents Who Receive Outpatient Mental Health Services: Qualitative Evaluation.","authors":"Ana Ramirez, Justin Kramer, Katrina Hazim, Jason Roberge","doi":"10.2196/60317","DOIUrl":"10.2196/60317","url":null,"abstract":"<p><strong>Background: </strong>Incidents of depression, anxiety, and suicidal ideation among adolescents have increased in recent years. Mental health interventions tailored to adolescents and families need to consider mechanisms for increasing enrollment and sustaining program engagement. A telephone-based, health coach intervention for adolescents and families was implemented at a Southeastern US health system with the goals of improving psychiatric appointment attendance, medication adherence, reduction in emergency department visits, and assisting with crisis management (\"Youth and Family Engagement\" [YFE] program).</p><p><strong>Objective: </strong>This study aims to explore patients' and parents' perceptions of a mental health program and the factors that impact enrollment and sustained engagement.</p><p><strong>Methods: </strong>Semistructured interviews were conducted with adolescent patients (n=9, 56%), parents (n=11, 92%), and clinicians who placed patient referrals (n=6, 100%). Interviews were in English (participants: 19/26, 73%) or Spanish (parents: 7/11, 64%), depending upon participants' preference. Interviews explored perceptions of the YFE program, experiences working with health coaches, suggestions for program changes, and program goals. The data were analyzed using inductive coding methodologies, with thematic analysis used to organize emergent themes. Two qualitatively trained researchers, one bilingual in English and Spanish, facilitated all data collection and collaboratively performed data analysis.</p><p><strong>Results: </strong>The YFE program's structure was often mentioned as promoting engagement, with telephone appointments and health coaches' ability to accommodate inflexible work or school schedules alleviating participation barriers. Skills learned from health coaches were frequently referenced, with adolescents generally citing internal processes, such as positive thinking and mindfulness. Parents discussed behaviors relative to their children, such as improvements with discipline, setting boundaries, and improved parent-child communication. Many participants discussed the importance of health coaches assisting families in navigating social systems, such as accessing resources (eg, housing) and navigating school processes (eg, individualized educational plans), with clinicians suggesting an increased emphasis on adolescents' nutrition and engagement in primary care. Spanish-speaking parents highlighted numerous advantages of working with bilingual health coaches, emphasizing both enhanced communication and cultural understanding. They specifically noted the coaches' ability to grasp their lived experiences and challenges as immigrants in the United States, which significantly enriched their participation in the program.</p><p><strong>Conclusions: </strong>Prioritizing convenient engagement for adolescents and families may be important for sustained program participation, as inflexible schedules and competing pri","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142557877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Self-Reported Patient and Provider Satisfaction With Neurology Telemedicine Visits After Rapid Telemedicine Implementation in an Urban Academic Center: Cross-Sectional Survey.","authors":"Noah Robertson, Maryam J Syed, Bowen Song, Arshdeep Kaur, Janaki G Patel, Rohit Marawar, Maysaa Basha, Deepti Zutshi","doi":"10.2196/53491","DOIUrl":"https://doi.org/10.2196/53491","url":null,"abstract":"<p><strong>Background: </strong>Many clinics and health systems implemented telemedicine appointment services out of necessity due to the COVID-19 pandemic.</p><p><strong>Objective: </strong>Our objective was to evaluate patient and general provider satisfaction with neurology telemedicine implementation at an urban academic medical center.</p><p><strong>Methods: </strong>Patients who had completed 1 or more teleneurology visits from April 1 to December 31, 2020, were asked to complete a survey regarding their demographic information and satisfaction with teleneurology visits. Providers of all specialties within the same hospital system were given a different survey to gather their experiences of providing telemedicine care.</p><p><strong>Results: </strong>Of the estimated 1500 patients who had completed a teleneurology visit within the given timeframe, 117 (7.8%) consented to complete the survey. Of these 117 respondents, most appointments were regarding epilepsy (n=59, 50.4%), followed by multiple sclerosis (n=33, 28.2%) and neuroimmunology (n=7, 6%). Overall, 74.4% (n=87) of patients rated their experience as 8 out of 10 or higher, with 10 being the highest satisfaction. Furthermore, 75.2% (n=88) of patients reported missing an appointment in the previous year due to transportation issues and thought telemedicine was more convenient instead. A significant relationship between racial or ethnic group and comfort sharing private information was found (P<.001), with 52% (26/50) of Black patients reporting that an office visit is better, compared to 25% (14/52) of non-Black patients. The provider survey gathered 40 responses, with 75% (n=30) of providers agreeing that virtual visits are a valuable tool for patient care and 80% (n=32) reporting few to no technical issues. The majority of provider respondents were physicians on faculty or staff (n=21, 52%), followed by residents or fellows (n=15, 38%) and nurse practitioners or physician assistants (n=4, 10%). Of the specialties represented, 15 (38%) of the providers were in neurology.</p><p><strong>Conclusions: </strong>Our study found adequate satisfaction among patients and providers regarding telemedicine implementation and its utility for patient care in a diverse urban population. Additionally, while access to technology and technology literacy are barriers to telemedical care, a substantial majority of patients who responded to the survey had access to devices (101/117, 86.3%) and were able to connect with few to no technological difficulties (84/117, 71.8%). One area identified by patients in need of improvement was comfortability in communicating via telemedicine with their providers. Furthermore, while providers agreed that telemedicine is a useful tool for patient care, it limits their ability to perform physical exams. More research and quality studies are needed to further appreciate and support the expansion of telemedical care into underserved and rural populations, especially in the a","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Katharina Preuhs, Daphne Bussink-Voorend, Hilde M van Keulen, Ilona Wildeman, Jeannine Hautvast, Marlies Hulscher, Pepijn van Empelen
{"title":"An Online Tailored COVID-19 Vaccination Decision Aid for Dutch Citizens: Development, Dissemination, and Use.","authors":"Katharina Preuhs, Daphne Bussink-Voorend, Hilde M van Keulen, Ilona Wildeman, Jeannine Hautvast, Marlies Hulscher, Pepijn van Empelen","doi":"10.2196/56390","DOIUrl":"https://doi.org/10.2196/56390","url":null,"abstract":"<p><strong>Background: </strong>Since December 2019, COVID-19 led to a pandemic causing many hospitalizations and deaths. Vaccinations were developed and introduced to control viral transmission. In the Dutch context, the decision to accept vaccination is not mandatory. An informed decision is based on sufficient and reliable information, in line with one's attitudes and values, and with consideration of pros and cons. To support people in informed decision-making, we developed an online COVID-19 vaccination decision aid (DA).</p><p><strong>Objective: </strong>This article aims to describe the development, dissemination, and use of the DA.</p><p><strong>Methods: </strong>Building on a previously developed DA, the COVID-19 vaccination DA was developed in 3 phases following a user-centered design approach: (1) definition phase, (2) concept testing, and (3) prototype testing. End users, individuals with low literacy, and experts (with relevant expertise on medical, behavioral, and low literacy aspects) were involved in the iterative development, design, and testing, with their feedback forming the basis for adaptations to the DA.</p><p><strong>Results: </strong>The DA was developed within 14 weeks. The DA consists of 3 modules, namely, Provide Information, Support Decision-Making, and Facilitate Actions Following a Decision. These modules are translated into various information tiles and diverse functionalities such as a knowledge test, a value clarification tool using a decisional balance, and a communication tool. The DA was disseminated for use in May 2021. Users varied greatly regarding age, gender, and location in the Netherlands.</p><p><strong>Conclusions: </strong>This paper elaborates on the development of the COVID-19 vaccination DA in a brief period and its dissemination for use among Dutch adults in the Netherlands. The evaluation of use showed that we were able to reach a large proportion and variety of people throughout the Netherlands.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Widana Kankanamge Darsha Jayamini, Farhaan Mirza, Marie-Claire Bidois-Putt, M Asif Naeem, Amy Hai Yan Chan
{"title":"Perceptions Toward Using Artificial Intelligence and Technology for Asthma Attack Risk Prediction: Qualitative Exploration of Māori Views.","authors":"Widana Kankanamge Darsha Jayamini, Farhaan Mirza, Marie-Claire Bidois-Putt, M Asif Naeem, Amy Hai Yan Chan","doi":"10.2196/59811","DOIUrl":"10.2196/59811","url":null,"abstract":"<p><strong>Background: </strong>Asthma is a significant global health issue, impacting over 500,000 individuals in New Zealand and disproportionately affecting Māori communities in New Zealand, who experience worse asthma symptoms and attacks. Digital technologies, including artificial intelligence (AI) and machine learning (ML) models, are increasingly popular for asthma risk prediction. However, these AI models may underrepresent minority ethnic groups and introduce bias, potentially exacerbating disparities.</p><p><strong>Objective: </strong>This study aimed to explore the views and perceptions that Māori have toward using AI and ML technologies for asthma self-management, identify key considerations for developing asthma attack risk prediction models, and ensure Māori are represented in ML models without worsening existing health inequities.</p><p><strong>Methods: </strong>Semistructured interviews were conducted with 20 Māori participants with asthma, 3 male and 17 female, aged 18-76 years. All the interviews were conducted one-on-one, except for 1 interview, which was conducted with 2 participants. Altogether, 10 web-based interviews were conducted, while the rest were kanohi ki te kanohi (face-to-face). A thematic analysis was conducted to identify the themes. Further, sentiment analysis was carried out to identify the sentiments using a pretrained Bidirectional Encoder Representations from Transformers model.</p><p><strong>Results: </strong>We identified four key themes: (1) concerns about AI use, (2) interest in using technology to support asthma, (3) desired characteristics of AI-based systems, and (4) experience with asthma management and opportunities for technology to improve care. AI was relatively unfamiliar to many participants, and some of them expressed concerns about whether AI technology could be trusted, kanohi ki te kanohi interaction, and inadequate knowledge of AI and technology. These concerns are exacerbated by the Māori experience of colonization. Most of the participants were interested in using technology to support their asthma management, and we gained insights into user preferences regarding computer-based health care applications. Participants discussed their experiences, highlighting problems with health care quality and limited access to resources. They also mentioned the factors that trigger their asthma control level.</p><p><strong>Conclusions: </strong>The exploration revealed that there is a need for greater information about AI and technology for Māori communities and a need to address trust issues relating to the use of technology. Expectations in relation to computer-based applications for health purposes were expressed. The research outcomes will inform future investigations on AI and technology to enhance the health of people with asthma, in particular those designed for Indigenous populations in New Zealand.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Saubhagya Joshi, Eunbin Ha, Andee Amaya, Melissa Mendoza, Yonaira Rivera, Vivek K Singh
{"title":"Ensuring Accuracy and Equity in Vaccination Information From ChatGPT and CDC: Mixed-Methods Cross-Language Evaluation.","authors":"Saubhagya Joshi, Eunbin Ha, Andee Amaya, Melissa Mendoza, Yonaira Rivera, Vivek K Singh","doi":"10.2196/60939","DOIUrl":"https://doi.org/10.2196/60939","url":null,"abstract":"<p><strong>Background: </strong>In the digital age, large language models (LLMs) like ChatGPT have emerged as important sources of health care information. Their interactive capabilities offer promise for enhancing health access, particularly for groups facing traditional barriers such as insurance and language constraints. Despite their growing public health use, with millions of medical queries processed weekly, the quality of LLM-provided information remains inconsistent. Previous studies have predominantly assessed ChatGPT's English responses, overlooking the needs of non-English speakers in the United States. This study addresses this gap by evaluating the quality and linguistic parity of vaccination information from ChatGPT and the Centers for Disease Control and Prevention (CDC), emphasizing health equity.</p><p><strong>Objective: </strong>This study aims to assess the quality and language equity of vaccination information provided by ChatGPT and the CDC in English and Spanish. It highlights the critical need for cross-language evaluation to ensure equitable health information access for all linguistic groups.</p><p><strong>Methods: </strong>We conducted a comparative analysis of ChatGPT's and CDC's responses to frequently asked vaccination-related questions in both languages. The evaluation encompassed quantitative and qualitative assessments of accuracy, readability, and understandability. Accuracy was gauged by the perceived level of misinformation; readability, by the Flesch-Kincaid grade level and readability score; and understandability, by items from the National Institutes of Health's Patient Education Materials Assessment Tool (PEMAT) instrument.</p><p><strong>Results: </strong>The study found that both ChatGPT and CDC provided mostly accurate and understandable (eg, scores over 95 out of 100) responses. However, Flesch-Kincaid grade levels often exceeded the American Medical Association's recommended levels, particularly in English (eg, average grade level in English for ChatGPT=12.84, Spanish=7.93, recommended=6). CDC responses outperformed ChatGPT in readability across both languages. Notably, some Spanish responses appeared to be direct translations from English, leading to unnatural phrasing. The findings underscore the potential and challenges of using ChatGPT for health care access.</p><p><strong>Conclusions: </strong>ChatGPT holds potential as a health information resource but requires improvements in readability and linguistic equity to be truly effective for diverse populations. Crucially, the default user experience with ChatGPT, typically encountered by those without advanced language and prompting skills, can significantly shape health perceptions. This is vital from a public health standpoint, as the majority of users will interact with LLMs in their most accessible form. Ensuring that default responses are accurate, understandable, and equitable is imperative for fostering informed health decisions across diverse co","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545633","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emelie Gustafson Hedov, Fredrik Nyberg, Stefan Gustafsson, Huiqi Li, Magnus Gisslén, Johan Sundström
{"title":"Person-Centered Web-Based Mobile Health System (Symptoms) for Reporting Symptoms in COVID-19 Vaccinated Individuals: Observational Study of System, Users, and Symptoms.","authors":"Emelie Gustafson Hedov, Fredrik Nyberg, Stefan Gustafsson, Huiqi Li, Magnus Gisslén, Johan Sundström","doi":"10.2196/57514","DOIUrl":"https://doi.org/10.2196/57514","url":null,"abstract":"<p><strong>Background: </strong>The full spectrum of side effects from COVID-19 vaccinations and infections, including milder symptoms or health effects that do not lead to health care visits, remains unknown. Person-centered self-reporting of symptoms may offer a solution. Monitoring patient-reported outcomes over time will vary in importance for different patients. Individuals have unique needs and preferences, in terms of both communication methods and how the collected information is used to support care.</p><p><strong>Objective: </strong>This study aims to describe how Symptoms, a system for person-centered self-reporting of symptoms and health-related quality of life, was utilized in investigating COVID-19 vaccine side effects. We illustrate this by presenting data from the Symptoms system in newly vaccinated individuals from the RECOVAC (Register-based large-scale national population study to monitor COVID-19 vaccination effectiveness and safety) study.</p><p><strong>Methods: </strong>During the COVID-19 pandemic, newly vaccinated individuals were identified as the ideal population to query for milder symptoms related to COVID-19 vaccinations and infections. To this end, we used posters in observation areas at 150 vaccination sites across the Västra Götaland region of Sweden, inviting newly vaccinated individuals to use a novel digital system, Symptoms. In the Symptoms system, users can track their symptoms, functioning, and quality of life as often as they wish, using evidence-based patient-reported outcome measures and short numeric rating scales. These scales cover a prespecified list of symptoms based on common COVID-19 symptoms and previously reported vaccine side effects. Participants could also use numeric rating scales for self-defined symptoms if their symptom was not included on the prespecified list.</p><p><strong>Results: </strong>A total of 731 people created user accounts and consented to share data for research between July 21, 2021, and September 27, 2022. The majority of users were female (444/731, 60.7%), with a median age of 38 (IQR 30-47) years. Most participants (498/702, 70.9%) did not report any of the comorbidities included in the questionnaire. Of the 731 participants, 563 (77.0%) reported experiencing 1 or more symptoms. The most common symptom was pain at the injection site (486/563, 86.3%), followed by fatigue (181/563, 32.1%) and headache (169/563, 30.0%). In total, 143 unique symptoms were reported. Of these, 29 were from the prespecified list, while the remaining 114 (79.7%) were self-defined entries in the symptom field. This suggests that the flexibility of the self-directed system-allowing individuals to decide which symptoms they consider worth tracking-may be an important feature.</p><p><strong>Conclusions: </strong>Self-reported symptoms in the Symptoms system appeared to align with previously observed post-COVID-19 vaccination symptoms. The system was relatively easy to use and successfully captured br","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christopher Hernandez, Christopher Rowe, Janet Ikeda, Justine Arenander, Glenn-Milo Santos
{"title":"Interest in the Use of Herbal Supplements to Close the Treatment Gap for Hazardous Alcohol Use Among Men Who Have Sex With Men: Secondary Analysis of a Cross-Sectional Study.","authors":"Christopher Hernandez, Christopher Rowe, Janet Ikeda, Justine Arenander, Glenn-Milo Santos","doi":"10.2196/60370","DOIUrl":"https://doi.org/10.2196/60370","url":null,"abstract":"<p><strong>Background: </strong>Hazardous alcohol consumption is highly prevalent for men who have sex with men (MSM). The 4 treatments currently approved by the Food and Drug Administration for alcohol use are reaching an alarmingly low percentage of people who would benefit from a reduction in their alcohol use. There is increasing interest in alternative methods of treatment, such as herbal supplements, to address hazardous drinking. However, research on the acceptability of alternative pharmacotherapies among MSM remains limited.</p><p><strong>Objective: </strong>We examined the prevalence and correlates of expressing interest in using herbal supplements for alcohol treatment among MSM with hazardous alcohol consumption.</p><p><strong>Methods: </strong>We conducted a secondary data analysis from a cross-sectional study of MSM who use alcohol, conducted from March 2015 to July 2017 in San Francisco, California, to assess the overall prevalence of interest in using herbal supplements to help reduce alcohol consumption. Associations between expressing interest in herbal supplements and demographic, social, and clinical characteristics were examined using bivariate and multivariable logistic regression models.</p><p><strong>Results: </strong>One-third (66/200, 33%) of the participants expressed interest in an herbal supplement for reducing alcohol consumption. In the multivariable analyses, weekly binge drinking (adjusted odds ratio [aOR] 2.85, 95% CI 1.17-6.93), interest in abstaining from alcohol use (aOR 5.04, 95% CI 1.46-17.40), higher severity of alcohol dependence score (aOR 1.22, 95% CI 1.04-1.41), and interest in naltrexone (aOR 3.22, 95% CI 2.12-4.91) were independently associated with higher odds of being interested in using an herbal supplement to reduce alcohol consumption, adjusting for age, race or ethnicity, and education.</p><p><strong>Conclusions: </strong>We found that MSM who have hazardous drinking habits, more severe alcohol dependence, and interest in pharmacotherapy were more likely to express interest in using an herbal supplement for reducing alcohol consumption. To our knowledge, this is the first study that has evaluated correlates of interest in herbal supplements for alcohol use among MSM. As researchers implement novel alcohol treatment studies, they should focus on recruitment efforts among MSM with a motivation to reduce their alcohol use patterns.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545634","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}