{"title":"Linking Cancer Clinical Trials to their Result Publications.","authors":"Evan Pan, Kirk Roberts","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The results of clinical trials are a valuable source of evidence for researchers, policy makers, and healthcare professionals. However, online trial registries do not always contain links to the publications that report on their results, instead requiring a time-consuming manual search. Here, we explored the application of pre-trained transformer-based language models to automatically identify result-reporting publications of cancer clinical trials by computing dense vectors and performing semantic search. Models were fine-tuned on text data from trial registry fields and article metadata using a contrastive learning approach. The best performing model was PubMedBERT, which achieved a mean average precision of 0.592 and ranked 70.3% of a trial's publications in the top 5 results when tested on the holdout test trials. Our results suggest that semantic search using embeddings from transformer models may be an effective approach to the task of linking trials to their publications.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"642-651"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141816/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aaron D Mullen, Samuel E Armstrong, Jeff Talbert, V K Cody Bumgardner
{"title":"CLASSify: A Web-Based Tool for Machine Learning.","authors":"Aaron D Mullen, Samuel E Armstrong, Jeff Talbert, V K Cody Bumgardner","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Machine learning classification problems are widespread in bioinformatics, but the technical knowledge required to perform model training, optimization, and inference can prevent researchers from utilizing this technology. This article presents an automated tool for machine learning classification problems to simplify the process of training models and producing results while providing informative visualizations and insights into the data. This tool supports both binary and multiclass classification problems, and it provides access to a variety of models and methods. Synthetic data can be generated within the interface to fill missing values, balance class labels, or generate entirely new datasets. It also provides support for feature evaluation and generates explainability scores to indicate which features influence the output the most. We present CLASSify, an open-source tool for simplifying the user experience of solving classification problems without the need for knowledge of machine learning.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"364-373"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141843/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141198601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Martin Chapman, Abigail G-Medhin, Kian Daneshi, Tom Bramwell, Stevo Durbaba, Vasa Curcin, Divya Parmar, Harriet Boulding, Laia Becares, Craig Morgan, Mariam Molokhia, Peter McBurney, Seeromanie Harding, Ingrid Wolfe, Mark Ashworth, Lucilla Poston
{"title":"Mechanisms for Integrating Real Data into Search Game Simulations: An Application to Winter Health Service Pressures and Preventative Policies.","authors":"Martin Chapman, Abigail G-Medhin, Kian Daneshi, Tom Bramwell, Stevo Durbaba, Vasa Curcin, Divya Parmar, Harriet Boulding, Laia Becares, Craig Morgan, Mariam Molokhia, Peter McBurney, Seeromanie Harding, Ingrid Wolfe, Mark Ashworth, Lucilla Poston","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>While modelling and simulation are powerful techniques for exploring complex phenomena, if they are not coupled with suitable real-world data any results obtained are likely to require extensive validation. We consider this problem in the context of search game modelling, and suggest that both demographic and behaviour data are used to configure certain model parameters. We show this integration in practice by using a combined dataset of over 150,000 individuals to configure a specific search game model that captures the environment, population, interventions and individual behaviours relating to winter health service pressures. The presence of this data enables us to more accurately explore the potential impact of service pressure interventions, which we do across 33,000 simulations using a computational version of the model. We find government advice to be the best-performing intervention in simulation, in respect of improved health, reduced health inequalities, and thus reduced pressure on health service utilisation.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"115-124"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141793/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tanmoy Paul, Omiya Hassan, Syed K Islam, Abu S M Mosa
{"title":"Real-Time Obstructive Sleep Apnea Detection from Raw ECG and SpO<sub>2</sub> Signal Using Convolutional Neural Network.","authors":"Tanmoy Paul, Omiya Hassan, Syed K Islam, Abu S M Mosa","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Obstructive sleep apnea is a sleep disorder that is linked with many health complications and severe form of apnea can even be lethal. Overnight polysomnography is the gold standard for diagnosing apnea, which is expensive, time-consuming, and requires manual analysis by a sleep expert. Recently, there have been numerous studies demonstrating the application of artificial intelligence to detect apnea in real time. But the majority of these studies apply data pre-processing and feature extraction techniques resulting in a longer inference time that makes the real-time detection system inefficient. This study proposes a single convolutional neural network architecture that can automatically extract spatial features and detect apnea from both electrocardiogram (ECG) and blood-oxygen saturation (SpO<sub>2</sub>) signals. Using segments of 10s, the network classified apnea with an accuracy of 94.2% and 96% for ECG and SpO<sub>2</sub> respectively. Moreover, the overall performance of both models was consistent with an AUC score of 0.99.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"662-669"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141842/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dongsuk Jang, Hyeryun Park, Jiye Son, Hyeonuk Hwang, Su-Jin Kim, Jinwook Choi
{"title":"Automated Information Extraction from Thyroid Operation Narrative: A Comparative Study of GPT-4 and Fine-tuned KoELECTRA.","authors":"Dongsuk Jang, Hyeryun Park, Jiye Son, Hyeonuk Hwang, Su-Jin Kim, Jinwook Choi","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>In the rapidly evolving field of healthcare, the integration of artificial intelligence (AI) has become a pivotal component in the automation of clinical workflows, ushering in a new era of efficiency and accuracy. This study focuses on the transformative capabilities of the fine-tuned KoELECTRA model in comparison to the GPT-4 model, aiming to facilitate automated information extraction from thyroid operation narratives. The current research landscape is dominated by traditional methods heavily reliant on regular expressions, which often face challenges in processing free-style text formats containing critical details of operation records, including frozen biopsy reports. Addressing this, the study leverages advanced natural language processing (NLP) techniques to foster a paradigm shift towards more sophisticated data processing systems. Through this comparative study, we aspire to unveil a more streamlined, precise, and efficient approach to document processing in the healthcare domain, potentially revolutionizing the way medical data is handled and analyzed.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"249-257"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141853/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Saubhagya Joshi, Eunbin Ha, Yonaira Rivera, Vivek K Singh
{"title":"ChatGPT and Vaccine Hesitancy: A Comparison of English, Spanish, and French Responses Using a Validated Scale.","authors":"Saubhagya Joshi, Eunbin Ha, Yonaira Rivera, Vivek K Singh","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>ChatGPT is a popular information system (over 1 billion visits in August 2023) that can generate natural language responses to user queries. It is important to study the quality and equity of its responses on health-related topics, such as vaccination, as they may influence public health decision-making. We use the Vaccine Hesitancy Scale (VHS) proposed by Shapiro et al.<sup>1</sup> to measure the hesitancy of ChatGPT responses in English, Spanish, and French. We find that: (a) ChatGPT responses indicate less hesitancy than those reported for human respondents in past literature; (b) ChatGPT responses vary significantly across languages, with English responses being the most hesitant on average and Spanish being the least; (c) ChatGPT responses are largely consistent across different model parameters but show some variations across the scale factors (vaccine competency, risk). Results have implications for researchers interested in evaluating and improving the quality and equity of health-related web information.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"266-275"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141820/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andrew R Ahn, Emmanuel Edu, Christina J O'Malley, Laura Kavanaugh, Alex Leiser, Linh Palcher, Christopher Erickson, Marissa Marchese, C William Hanson
{"title":"A Roadmap for Improving Telemedicine Support Operations.","authors":"Andrew R Ahn, Emmanuel Edu, Christina J O'Malley, Laura Kavanaugh, Alex Leiser, Linh Palcher, Christopher Erickson, Marissa Marchese, C William Hanson","doi":"","DOIUrl":"","url":null,"abstract":"","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"63-64"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141798/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xiaodan Zhang, Nabasmita Talukdar, Sandeep Vemulapalli, Sumyeong Ahn, Jiankun Wang, Han Meng, Sardar Mehtab Bin Murtaza, Dmitry Leshchiner, Aakash Ajay Dave, Dimitri F Joseph, Martin Witteveen-Lane, Dave Chesla, Jiayu Zhou, Bin Chen
{"title":"Comparison of Prompt Engineering and Fine-Tuning Strategies in Large Language Models in the Classification of Clinical Notes.","authors":"Xiaodan Zhang, Nabasmita Talukdar, Sandeep Vemulapalli, Sumyeong Ahn, Jiankun Wang, Han Meng, Sardar Mehtab Bin Murtaza, Dmitry Leshchiner, Aakash Ajay Dave, Dimitri F Joseph, Martin Witteveen-Lane, Dave Chesla, Jiayu Zhou, Bin Chen","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The emerging large language models (LLMs) are actively evaluated in various fields including healthcare. Most studies have focused on established benchmarks and standard parameters; however, the variation and impact of prompt engineering and fine-tuning strategies have not been fully explored. This study benchmarks GPT-3.5 Turbo, GPT-4, and Llama-7B against BERT models and medical fellows' annotations in identifying patients with metastatic cancer from discharge summaries. Results revealed that clear, concise prompts incorporating reasoning steps significantly enhanced performance. GPT-4 exhibited superior performance among all models. Notably, one-shot learning and fine-tuning provided no incremental benefit. The model's accuracy sustained even when keywords for metastatic cancer were removed or when half of the input tokens were randomly discarded. These findings underscore GPT-4's potential to substitute specialized models, such as PubMedBERT, through strategic prompt engineering, and suggest opportunities to improve open-source models, which are better suited to use in clinical settings.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"478-487"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141826/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141199710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lorna Pairman, Paul Chin, Sharon J Gardiner, Matthew Doogue
{"title":"Compulsory Indications in Hospital Prescribing Software Tested with Antibacterial Prescriptions.","authors":"Lorna Pairman, Paul Chin, Sharon J Gardiner, Matthew Doogue","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The aim was to assess how making the indication field compulsory in our electronic prescribing system influenced free text documentation and to visualise prescriber behaviour. The indication field was made compulsory for seven antibacterial medicines. Text recorded in the indication field was manually classified as 'indication present', 'other text', 'rubbish text', or 'blank'. The proportion of prescriptions with an indication was compared for four weeks before and after the intervention. Indication provision increased from 10.6% to 72.4% (p<0.01) post-intervention. 'Other text' increased from 7.6% to 25.1% (p<0.01), and 'rubbish text' from 0.0% to 0.6% (p<0.01). Introducing the compulsory indication field increased indication documentation substantially with only a small increase in 'rubbish text'. An interactive report was developed using a live data extract to illustrate indication provision for all medicines prescribed at our tertiary hospital. The interactive report was validated and locally published to support audit and quality improvement projects.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"632-641"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141823/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141200027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing the Barriers and Facilitators to Pulmonary Rehabilitation Referrals Using the Consolidated Framework for Implementation Research (CFIR).","authors":"Aileen S Gabriel, Joseph Finkelstein","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Chronic obstructive pulmonary disease (COPD) is a global health issue causing significant illness and death. Pulmonary Rehabilitation (PR) offers non-pharmacological treatment, including education, exercise, and psychological support which was shown to improve clinical outcomes. In both stable COPD and after an acute exacerbation, PR has been demonstrated to increase exercise capacity, decrease dyspnea, and enhance quality of life. Despite these benefits, referrals for PR for COPD treatment remain low. This study aims to evaluate the perceptions of healthcare providers for referring a COPD patient to PR. Semi-structured qualitative interviews were conducted with pulmonary specialists, hospitalists, and emergency department physicians. Domains and constructs from the Consolidated Framework for Implementation Research (CFIR) were applied to the qualitative data to organize, analyze, and identify the barriers and facilitators to referring COPD patients. The findings from this study will help guide strategies to improve the referral process for PR.</p>","PeriodicalId":72181,"journal":{"name":"AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science","volume":"2024 ","pages":"172-181"},"PeriodicalIF":0.0,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11141829/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141201475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}