{"title":"Ethicara for Responsible AI in Healthcare: A System for Bias Detection and AI Risk Management.","authors":"Maria Kritharidou, Georgios Chrysogonidis, Tasos Ventouris, Vaios Tsarapastsanis, Danai Aristeridou, Anastasia Karatzia, Veena Calambur, Ahsan Huda, Sabrina Hsueh","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The increasing torrents of health AI innovations hold promise for facilitating the delivery of patient-centered care. Yet the enablement and adoption of AI innovations in the healthcare and life science industries can be challenging with the rising concerns of AI risks and the potential harms to health equity. This paper describes Ethicara, a system that enables health AI risk assessment for responsible AI model development. Ethicara works by orchestrating a collection of self-analytics services that detect and mitigate bias and increase model transparency from harmonized data models. For the lack of risk controls currently in the health AI development and deployment process, the self-analytics tools enhanced by Ethicara are expected to provide repeatable and measurable controls to operationalize voluntary risk management frameworks and guidelines (e.g., NIST RMF, FDA GMLP) and regulatory requirements emerging from the upcoming AI regulations (e.g., EU AI Act, US Blueprint for an AI Bill of Rights). In addition, Ethicara provides plug-ins via which analytics results are incorporated into healthcare applications. This paper provides an overview of Ethicara's architecture, pipeline, and technical components and showcases the system's capability to facilitate responsible AI use, and exemplifies the types of AI risk controls it enables in the healthcare and life science industry.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"2023-2032"},"PeriodicalIF":0.0,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11492113/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142482192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sirui Ding, Qiaoyu Tan, Chia-Yuan Chang, Na Zou, Kai Zhang, Nathan R Hoot, Xiaoqian Jiang, Xia Hu
{"title":"Multi-Task Learning for Post-transplant Cause of Death Analysis: A Case Study on Liver Transplant.","authors":"Sirui Ding, Qiaoyu Tan, Chia-Yuan Chang, Na Zou, Kai Zhang, Nathan R Hoot, Xiaoqian Jiang, Xia Hu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Organ transplant is the essential treatment method for some end-stage diseases, such as liver failure. Analyzing the post-transplant cause of death (CoD) after organ transplant provides a powerful tool for clinical decision making, including personalized treatment and organ allocation. However, traditional methods like Model for End-stage Liver Disease (MELD) score and conventional machine learning (ML) methods are limited in CoD analysis due to two major data and model-related challenges. To address this, we propose a novel framework called CoD-MTL leveraging multi-task learning to model the semantic relationships between various CoD prediction tasks jointly. Specifically, we develop a novel tree distillation strategy for multi-task learning, which combines the strength of both the tree model and multi-task learning. Experimental results are presented to show the precise and reliable CoD predictions of our framework. A case study is conducted to demonstrate the clinical importance of our method in the liver transplant.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"913-922"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785876/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support.","authors":"Zilin Ma, Yiyang Mei, Zhaoyuan Su","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Conversational agents powered by large language models (LLM) have increasingly been utilized in the realm of mental well-being support. However, the implications and outcomes associated with their usage in such a critical field remain somewhat ambiguous and unexplored. We conducted a qualitative analysis of 120 posts, encompassing 2917 user comments, drawn from the most popular subreddit focused on mental health support applications powered by large language models (u/Replika). This exploration aimed to shed light on the advantages and potential pitfalls associated with the integration of these sophisticated models in conversational agents intended for mental health support. We found the app (Replika) beneficial in offering on-demand, non-judgmental support, boosting user confidence, and aiding self-discovery. Yet, it faced challenges in filtering harmful content, sustaining consistent communication, remembering new information, and mitigating users' overdependence. The stigma attached further risked isolating users socially. We strongly assert that future researchers and designers must thoroughly evaluate the appropriateness of employing LLMs for mental well-being support, ensuring their responsible and effective application.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"1105-1114"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785945/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139465800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Johann Frei, Florian J Auer, Steffen Netzband, Yevgeniia Ignatenko, Frank Kramer
{"title":"Web-based Prototype for Graphical Exploration of FHIR® Questionnaire Responses.","authors":"Johann Frei, Florian J Auer, Steffen Netzband, Yevgeniia Ignatenko, Frank Kramer","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The evaluation of clinical questionnaires is an important part of gaining knowledge in empirical research. The electronically captured responses are encoded in a standard format such as HL7 FHIR® that facilitates data exchange and systems interoperability. However, this also complicates access of the information to explore and interpret the results without appropriate tools. In this work, we present the design of a web-based graphical exploration tool for categorical questionnaire response data that can interact with FHIR-conformant HTTP endpoints. The web app enables non-technical users with simplified, direct visual access to highly structured FHIR questionnaire response data and preserves the applicability in arbitrary data exploration tasks. We describe the abstract feature design with the derived technical implementation to allow a universal, user-configurable data subselection mechanism to generate conditional one- and two-data-dimensional charts. The applicability of our developed prototype is demonstrated on synthetic FHIR data with the source code available at https://github.com/frankkramer-lab/FHIR-QR-Explorer.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"351-358"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785863/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139466304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Savitha Sangameswaran, Megan Laine, Nick Reid, Serena Jinchen Xie, Liz Zampino, Michelle M Garrison, Dori E Rosenberg, Jason C Yip, Andrea L Hartzler
{"title":"Co-designing mind-body technologies for sleep with adolescents.","authors":"Savitha Sangameswaran, Megan Laine, Nick Reid, Serena Jinchen Xie, Liz Zampino, Michelle M Garrison, Dori E Rosenberg, Jason C Yip, Andrea L Hartzler","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Sleep is critical for well-being, yet adolescents do not get enough sleep. Mind-body approaches can help. Despite the potential of technology to support mind-body approaches for sleep, there is a lack of research on adolescent preferences for digital mind-body technology. We use co-design to examine adolescent perspectives on mind-body technologies for sleep. From our analysis of design sessions with 16 adolescents, four major themes emerged: system behavior, modality, content, and context. In light of these key findings, we recommend that technology-based mind-body approaches to sleep for adolescents be designed to 1) serve multiple functions while avoiding distractions, 2) provide intelligent content while maintaining privacy and trust, 3) provide a variety of content with the ability to customize and personalize, 4) offer multiple modalities for interaction with technology, and 5) consider the context of adolescent and their families. Findings provide a foundation for designing mind-body technologies for adolescent sleep.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"1257-1266"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785901/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yashwanth Ravipati, Nader Pouratian, Corey Arnold, William Speier
{"title":"Evaluating Deep Learning Performance for P300 Neural Signal Classification.","authors":"Yashwanth Ravipati, Nader Pouratian, Corey Arnold, William Speier","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>P300 event-related potential (ERP) signals are useful neurological biomarkers, and their accurate classification is important when studying the cognitive functions in patients with neurological disorders. While many studies have proposed models for classifying these signals, results have been inconsistent. As a result, a consensus has not yet been reached on the optimal model for this classification. In this study, we evaluated the performance of classic machine learning and novel deep learning methods for P300 signal classification in both within and across subject training scenarios across a dataset of 75 subjects. Although the deep learning models attained high attended event classification F1 scores, they did not outperform Stepwise Linear Discriminant Analysis (SWLDA) in the within-subject paradigm. In the across-subject paradigm, however, EEG-Inception was able to significantly outperform SWLDA. These results suggest that deep learning models may provide a general model that do not require subject-specific training and calibration in clinical settings.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"1218-1225"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785884/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467464","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zhan Zhang, Jina Huh-Yoo, Karen Joy, Monica Angeles, David Sachs, John Migliaccio, Melody K Schiaffino
{"title":"Experiences and Perceptions of Distinct Telehealth Delivery Models for Remote Patient Monitoring among Older Adults in the Community.","authors":"Zhan Zhang, Jina Huh-Yoo, Karen Joy, Monica Angeles, David Sachs, John Migliaccio, Melody K Schiaffino","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Three major telehealth delivery models-home-based, community-based, and telephone-based-have been adopted to enable remote patient monitoring of older adults to improve patient experience and reduce healthcare costs. Even though prior work has evaluated each of these delivery models, we know less about the perceptions and user experiences across these telehealth delivery models for older adults. In the present work, we addressed this research gap by interviewing 16 older adults who had experience using all these telehealth delivery models. We found that the community-based telehealth model with in-person interactions was perceived as the most preferred and useful program, followed by home-based and telephone-based models. Persistent needs reported by participants included ease of access to their historical physiological data, useful educational information for health self-management, and additional health status tracking. Our findings will inform the design and deployment of telehealth technology for vulnerable aging populations.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"794-803"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785840/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aman Pathak, Zehao Yu, Daniel Paredes, Elio Paul Monsour, Andrea Ortiz Rocha, Juan P Brito, Naykky Singh Ospina, Yonghui Wu
{"title":"Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods.","authors":"Aman Pathak, Zehao Yu, Daniel Paredes, Elio Paul Monsour, Andrea Ortiz Rocha, Juan P Brito, Naykky Singh Ospina, Yonghui Wu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The ultrasound characteristics of thyroid nodules guide the evaluation of thyroid cancer in patients with thyroid nodules. However, the characteristics of thyroid nodules are often documented in clinical narratives such as ultrasound reports. Previous studies have examined natural language processing (NLP) methods in extracting a limited number of characteristics (<9) using rule-based NLP systems. In this study, a multidisciplinary team of NLP experts and thyroid specialists, identified thyroid nodule characteristics that are important for clinical care, composed annotation guidelines, developed a corpus, and compared 5 state-of-the-art transformer-based NLP methods, including BERT, RoBERTa, LongFormer, DeBERTa, and GatorTron, for extraction of thyroid nodule characteristics from ultrasound reports. Our GatorTron model, a transformer-based large language model trained using over 90 billion words of text, achieved the best strict and lenient F1-score of 0.8851 and 0.9495 for the extraction of a total number of 16 thyroid nodule characteristics, and 0.9321 for linking characteristics to nodules, outperforming other clinical transformer models. To the best of our knowledge, this is the first study to systematically categorize and apply transformer-based NLP models to extract a large number of clinical relevant thyroid nodule characteristics from ultrasound reports. This study lays ground for assessing the documentation quality of thyroid ultrasound reports and examining outcomes of patients with thyroid nodules using electronic health records.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"1193-1200"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785862/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fatigue, Pain, and Medication: Mining Online Posts Regarding Rheumatoid Arthritis From Reddit.","authors":"Yi Xin, Congning Ni, Qingyuan Song, Zhijun Yin","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Rheumatoid arthritis (RA), a chronic and systemic autoimmune disease that primarily attacks the joints around the body, is affecting a large number of people worldwide through severe symptoms and complications. Therefore, it is crucial to understand these patients' problems and support needs such that effective strategies or solutions can be made to improve their long-term treatment experience. In this paper, we present an in-depth study that is based on the structural topic model to uncover the themes and concerns in online RA posts from Reddit, an American social news aggregation, content rating, and discussion website. In addition, we compared the topic prevalence differences before and after the COVID-19 pandemic to understand the impact of the pandemic on these online users. This study demonstrates the potential of using text-mining techniques on social media data to learn the treatment experiments of RA patients.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"754-763"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785940/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467483","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eric S Hall, Genevieve B Melton, Philip R O Payne, David A Dorr, David K Vawdrey
{"title":"How Are Leading Research Institutions Engaging with Data Sharing Tools and Programs?","authors":"Eric S Hall, Genevieve B Melton, Philip R O Payne, David A Dorr, David K Vawdrey","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>With widespread electronic health record (EHR) adoption and improvements in health information interoperability in the United States, troves of data are available for knowledge discovery. Several data sharing programs and tools have been developed to support research activities, including efforts funded by the National Institutes of Health (NIH), EHR vendors, and other public- and private-sector entities. We surveyed 65 leading research institutions (77% response rate) about their use of and value derived from ten programs/tools, including NIH's Accrual to Clinical Trials, Epic Corporation's Cosmos, and the Observational Health Data Sciences and Informatics consortium. Most institutions participated in multiple programs/tools but reported relatively low usage (even when they participated, they frequently indicated that fewer than one individual/month benefitted from the platform to support research activities). Our findings suggest that investments in research data sharing have not yet achieved desired results.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2023 ","pages":"397-406"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10785902/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139467489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}