Naleef Fareed, Ramona G Olvera, Yiting Wang, Michael Hayes, Elizabeth Liz Larimore, Peter Balvanz, Ronald Langley, Corinna A Noel, Peter Rock, Daniel Redmond, Jessica Neufeld, Sarah Kosakowski, Daniel Harris, Marc LaRochelle, Timothy R Huerta, LaShawn Glasgow, Emmanuel Oga, Jennifer Villani, Elwin Wu
{"title":"从社区利益相关者开发仪表板以支持社区阿片类药物应对决策中汲取的经验教训:混合方法和多站点研究。","authors":"Naleef Fareed, Ramona G Olvera, Yiting Wang, Michael Hayes, Elizabeth Liz Larimore, Peter Balvanz, Ronald Langley, Corinna A Noel, Peter Rock, Daniel Redmond, Jessica Neufeld, Sarah Kosakowski, Daniel Harris, Marc LaRochelle, Timothy R Huerta, LaShawn Glasgow, Emmanuel Oga, Jennifer Villani, Elwin Wu","doi":"10.2196/51525","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Data dashboards are published tools that present visualizations; they are increasingly used to display data about behavioral health, social determinants of health, and chronic and infectious disease risks to inform or support public health endeavors. Dashboards can be an evidence-based approach used by communities to influence decision-making in health care for specific populations. Despite widespread use, evidence on how to best design and use dashboards in the public health realm is limited. There is also a notable dearth of studies that examine and document the complexity and heterogeneity of dashboards in community settings.</p><p><strong>Objective: </strong>Community stakeholders engaged in the community response to the opioid overdose crisis could benefit from the use of data dashboards for decision-making. As part of the Communities That HEAL (CTH) intervention, community data dashboards were created for stakeholders to support decision-making. We assessed stakeholders' perceptions of the usability and use of the CTH dashboards for decision-making.</p><p><strong>Methods: </strong>We conducted a mixed methods assessment between June and July 2021 on the use of CTH dashboards. We administered the System Usability Scale (SUS) and conducted semistructured group interviews with users in 33 communities across 4 states of the United States. The SUS comprises 10 five-point Likert-scale questions measuring usability, each scored from 0 to 4. The interview guides were informed by the technology adoption model (TAM) and focused on perceived usefulness, perceived ease of use, intention to use, and contextual factors.</p><p><strong>Results: </strong>Overall, 62 users of the CTH dashboards completed the SUS and interviews. SUS scores (grand mean 73, SD 4.6) indicated that CTH dashboards were within the acceptable range for usability. From the qualitative interview data, we inductively created subthemes within the 4 dimensions of the TAM to contextualize stakeholders' perceptions of the dashboard's usefulness and ease of use, their intention to use, and contextual factors. These data also highlighted gaps in knowledge, design, and use, which could help focus efforts to improve the use and comprehension of dashboards by stakeholders.</p><p><strong>Conclusions: </strong>We present a set of prioritized gaps identified by our national group and list a set of lessons learned for improved data dashboard design and use for community stakeholders. Findings from our novel application of both the SUS and TAM provide insights and highlight important gaps and lessons learned to inform the design of data dashboards for use by decision-making community stakeholders.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov NCT04111939; https://clinicaltrials.gov/study/NCT04111939.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e51525"},"PeriodicalIF":2.6000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11420584/pdf/","citationCount":"0","resultStr":"{\"title\":\"Lessons Learned From Developing Dashboards to Support Decision-Making for Community Opioid Response by Community Stakeholders: Mixed Methods and Multisite Study.\",\"authors\":\"Naleef Fareed, Ramona G Olvera, Yiting Wang, Michael Hayes, Elizabeth Liz Larimore, Peter Balvanz, Ronald Langley, Corinna A Noel, Peter Rock, Daniel Redmond, Jessica Neufeld, Sarah Kosakowski, Daniel Harris, Marc LaRochelle, Timothy R Huerta, LaShawn Glasgow, Emmanuel Oga, Jennifer Villani, Elwin Wu\",\"doi\":\"10.2196/51525\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Data dashboards are published tools that present visualizations; they are increasingly used to display data about behavioral health, social determinants of health, and chronic and infectious disease risks to inform or support public health endeavors. Dashboards can be an evidence-based approach used by communities to influence decision-making in health care for specific populations. Despite widespread use, evidence on how to best design and use dashboards in the public health realm is limited. There is also a notable dearth of studies that examine and document the complexity and heterogeneity of dashboards in community settings.</p><p><strong>Objective: </strong>Community stakeholders engaged in the community response to the opioid overdose crisis could benefit from the use of data dashboards for decision-making. As part of the Communities That HEAL (CTH) intervention, community data dashboards were created for stakeholders to support decision-making. We assessed stakeholders' perceptions of the usability and use of the CTH dashboards for decision-making.</p><p><strong>Methods: </strong>We conducted a mixed methods assessment between June and July 2021 on the use of CTH dashboards. We administered the System Usability Scale (SUS) and conducted semistructured group interviews with users in 33 communities across 4 states of the United States. The SUS comprises 10 five-point Likert-scale questions measuring usability, each scored from 0 to 4. The interview guides were informed by the technology adoption model (TAM) and focused on perceived usefulness, perceived ease of use, intention to use, and contextual factors.</p><p><strong>Results: </strong>Overall, 62 users of the CTH dashboards completed the SUS and interviews. SUS scores (grand mean 73, SD 4.6) indicated that CTH dashboards were within the acceptable range for usability. From the qualitative interview data, we inductively created subthemes within the 4 dimensions of the TAM to contextualize stakeholders' perceptions of the dashboard's usefulness and ease of use, their intention to use, and contextual factors. These data also highlighted gaps in knowledge, design, and use, which could help focus efforts to improve the use and comprehension of dashboards by stakeholders.</p><p><strong>Conclusions: </strong>We present a set of prioritized gaps identified by our national group and list a set of lessons learned for improved data dashboard design and use for community stakeholders. Findings from our novel application of both the SUS and TAM provide insights and highlight important gaps and lessons learned to inform the design of data dashboards for use by decision-making community stakeholders.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov NCT04111939; https://clinicaltrials.gov/study/NCT04111939.</p>\",\"PeriodicalId\":36351,\"journal\":{\"name\":\"JMIR Human Factors\",\"volume\":\"11 \",\"pages\":\"e51525\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11420584/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR Human Factors\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2196/51525\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Human Factors","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/51525","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
摘要
背景:数据仪表盘是一种可视化的发布工具;它们越来越多地用于显示有关行为健康、健康的社会决定因素以及慢性病和传染病风险的数据,为公共卫生工作提供信息或支持。仪表板可作为一种循证方法,被社区用于影响特定人群的医疗保健决策。尽管仪表盘被广泛使用,但有关如何在公共卫生领域以最佳方式设计和使用仪表盘的证据却很有限。此外,研究和记录社区环境中仪表盘的复杂性和异质性的研究也明显不足:参与社区应对阿片类药物过量危机的社区利益相关者可以从使用数据仪表盘进行决策中获益。作为 "健康社区"(Communities That HEAL,CTH)干预措施的一部分,我们为利益相关者创建了社区数据仪表盘,以支持决策。我们评估了利益相关者对 CTH 仪表板在决策中的可用性和使用情况的看法:我们在 2021 年 6 月至 7 月期间采用混合方法对 CTH 面板的使用情况进行了评估。我们采用了系统可用性量表(SUS),并对美国 4 个州 33 个社区的用户进行了半结构化小组访谈。访谈指南参考了技术采用模型(TAM),重点关注感知有用性、感知易用性、使用意向和环境因素:共有 62 名普通话仪表盘用户完成了 SUS 和访谈。SUS评分(总平均分73分,标准差4.6分)表明,CTH仪表盘的可用性在可接受范围内。从定性访谈数据中,我们归纳出了 TAM 的 4 个维度中的子主题,以便将利益相关者对仪表盘的实用性和易用性的看法、他们的使用意向以及背景因素具体化。这些数据还强调了在知识、设计和使用方面存在的差距,这有助于集中精力改善利益相关者对仪表盘的使用和理解:我们介绍了全国小组确定的一系列优先差距,并列出了一系列经验教训,以改进社区利益相关者对数据仪表盘的设计和使用。从我们对 SUS 和 TAM 的新颖应用中得出的结论为设计供决策社区利益相关者使用的数据仪表盘提供了启示,并强调了重要的差距和经验教训:ClinicalTrials.gov NCT04111939; https://clinicaltrials.gov/study/NCT04111939.
Lessons Learned From Developing Dashboards to Support Decision-Making for Community Opioid Response by Community Stakeholders: Mixed Methods and Multisite Study.
Background: Data dashboards are published tools that present visualizations; they are increasingly used to display data about behavioral health, social determinants of health, and chronic and infectious disease risks to inform or support public health endeavors. Dashboards can be an evidence-based approach used by communities to influence decision-making in health care for specific populations. Despite widespread use, evidence on how to best design and use dashboards in the public health realm is limited. There is also a notable dearth of studies that examine and document the complexity and heterogeneity of dashboards in community settings.
Objective: Community stakeholders engaged in the community response to the opioid overdose crisis could benefit from the use of data dashboards for decision-making. As part of the Communities That HEAL (CTH) intervention, community data dashboards were created for stakeholders to support decision-making. We assessed stakeholders' perceptions of the usability and use of the CTH dashboards for decision-making.
Methods: We conducted a mixed methods assessment between June and July 2021 on the use of CTH dashboards. We administered the System Usability Scale (SUS) and conducted semistructured group interviews with users in 33 communities across 4 states of the United States. The SUS comprises 10 five-point Likert-scale questions measuring usability, each scored from 0 to 4. The interview guides were informed by the technology adoption model (TAM) and focused on perceived usefulness, perceived ease of use, intention to use, and contextual factors.
Results: Overall, 62 users of the CTH dashboards completed the SUS and interviews. SUS scores (grand mean 73, SD 4.6) indicated that CTH dashboards were within the acceptable range for usability. From the qualitative interview data, we inductively created subthemes within the 4 dimensions of the TAM to contextualize stakeholders' perceptions of the dashboard's usefulness and ease of use, their intention to use, and contextual factors. These data also highlighted gaps in knowledge, design, and use, which could help focus efforts to improve the use and comprehension of dashboards by stakeholders.
Conclusions: We present a set of prioritized gaps identified by our national group and list a set of lessons learned for improved data dashboard design and use for community stakeholders. Findings from our novel application of both the SUS and TAM provide insights and highlight important gaps and lessons learned to inform the design of data dashboards for use by decision-making community stakeholders.