{"title":"Patient perspective on predictive models in healthcare: translation into practice, ethical implications and limitations?","authors":"Sarah Markham","doi":"10.1136/bmjhci-2024-101153","DOIUrl":"10.1136/bmjhci-2024-101153","url":null,"abstract":"<p><p>In this perspective article, we consider the use of predictive models in healthcare and associated challenges. We will argue that patients can play a valuable role in supporting the safe and practicable embedding of such tools and provide some examples.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"32 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751774/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142999866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jenna M Reps, Jenna Wong, Egill A Fridgeirsson, Chungsoo Kim, Luis H John, Ross D Williams, Renae R Fisher, Patrick B Ryan
{"title":"Finding a constrained number of predictor phenotypes for multiple outcome prediction.","authors":"Jenna M Reps, Jenna Wong, Egill A Fridgeirsson, Chungsoo Kim, Luis H John, Ross D Williams, Renae R Fisher, Patrick B Ryan","doi":"10.1136/bmjhci-2024-101227","DOIUrl":"10.1136/bmjhci-2024-101227","url":null,"abstract":"<p><strong>Background: </strong>Prognostic models help aid medical decision-making. Various prognostic models are available via websites such as MDCalc, but these models typically predict one outcome, for example, stroke risk. Each model requires individual predictors, for example, age, lab results and comorbidities. There is no clinical tool available to predict multiple outcomes from a list of common medical predictors.</p><p><strong>Objective: </strong>Identify a constrained set of outcome-agnostic predictors.</p><p><strong>Methods: </strong>We proposed a novel technique aggregating the standardised mean difference across hundreds of outcomes to learn a constrained set of predictors that appear to be predictive of many outcomes. Model performance was evaluated using the constrained set of predictors across eight prediction tasks. We compared against existing models, models using only age/sex predictors and models without any predictor constraints.</p><p><strong>Results: </strong>We identified 67 predictors in our constrained set, plus age/sex. Our predictors included illnesses in the following categories: cardiovascular, kidney/liver, mental health, gastrointestinal, infectious and oncologic. Models developed using the constrained set of predictors achieved comparable discrimination compared with models using hundreds or thousands of predictors for five of the eight prediction tasks and slightly lower discrimination for three of the eight tasks. The constrained predictor models performed as good or better than all existing clinical models.</p><p><strong>Conclusions: </strong>It is possible to develop models for hundreds or thousands of outcomes that use the same small set of predictors. This makes it feasible to implement many prediction models via a single website form. Our set of predictors can also be used for future models and prognostic model research.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"32 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751890/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142999864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Holly Tibble, Rami A Alyami, Andrew Bush, Steve Cunningham, Steven Julious, David Price, Jennifer K Quint, Stephen Turner, Kay Wang, Andrew Wilson, Gwyneth A Davies, Mome Mukherjee, Amy Hai Yan Chan, Deepa Varghese, Tracy Jackson, Noelle Morgan, Luke Daines, Hilary Pinnock
{"title":"Using routine primary care data in research: (in)efficient case studies and perspectives from the Asthma UK Centre for Applied Research.","authors":"Holly Tibble, Rami A Alyami, Andrew Bush, Steve Cunningham, Steven Julious, David Price, Jennifer K Quint, Stephen Turner, Kay Wang, Andrew Wilson, Gwyneth A Davies, Mome Mukherjee, Amy Hai Yan Chan, Deepa Varghese, Tracy Jackson, Noelle Morgan, Luke Daines, Hilary Pinnock","doi":"10.1136/bmjhci-2024-101134","DOIUrl":"10.1136/bmjhci-2024-101134","url":null,"abstract":"<p><strong>Aim: </strong>We aimed to identify enablers and barriers of using primary care routine data for healthcare research, to formulate recommendations for improving efficiency in knowledge discovery.</p><p><strong>Background: </strong>Data recorded routinely in primary care can be used for estimating the impact of interventions provided within routine care for all people who are clinically eligible. Despite official promotion of 'efficient trial designs', anecdotally researchers in the Asthma UK Centre for Applied Research (AUKCAR) have encountered multiple barriers to accessing and using routine data.</p><p><strong>Methods: </strong>Using studies within the AUKCAR portfolio as exemplars, we captured limitations, barriers, successes, and strengths through correspondence and discussions with the principal investigators and project managers of the case studies.</p><p><strong>Results: </strong>We identified 14 studies (8 trials, 2 developmental studies and 4 observational studies). Investigators agreed that using routine primary care data potentially offered a convenient collection of data for effectiveness outcomes, health economic assessment and process evaluation in one data extraction. However, this advantage was overshadowed by time-consuming processes that were major barriers to conducting efficient research. Common themes were multiple layers of information governance approvals in addition to the ethics and local governance approvals required by all health service research; lack of standardisation so that local approvals required diverse paperwork and reached conflicting conclusions as to whether a study should be approved. Practical consequences included a trial that over-recruited by 20% in order to randomise 144 practices with all required permissions, and a 5-year delay in reporting a trial while retrospectively applied regulations were satisfied to allow data linkage.</p><p><strong>Conclusions: </strong>Overcoming the substantial barriers of using routine primary care data will require a streamlined governance process, standardised understanding/application of regulations and adequate National Health Service IT (Information Technology) capability. Without policy-driven prioritisation of these changes, the potential of this valuable resource will not be leveraged.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"32 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751789/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142944284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kim Naude, David A Snowdon, Emily Parker, Roisin McNaney, Velandai Srikanth, Nadine E Andrew
{"title":"Sharing data matters: exploring the attitudes of older consumers on an emerging healthy ageing data platform using electronic health records for research.","authors":"Kim Naude, David A Snowdon, Emily Parker, Roisin McNaney, Velandai Srikanth, Nadine E Andrew","doi":"10.1136/bmjhci-2024-101126","DOIUrl":"10.1136/bmjhci-2024-101126","url":null,"abstract":"<p><strong>Background: </strong>In Australia, with the recent introduction of electronic health records (EHRs) into hospitals, the use of hospital-based EHRs for research is a relatively new concept. The aim of this study was to explore the attitudes of older healthcare consumers on sharing their health data with an emerging EHR-based Research Data Platform within the National Centre for Healthy Ageing.</p><p><strong>Methods: </strong>This was a qualitative study. Two workshops were conducted in March 2022 with consumer representatives across Peninsula Health, Victoria, Australia. The workshops comprised three parts: (1) an ice-breaker (2) an introduction to EHR-based research through the presentation of 'use case' scenarios and (3) focus group discussions. Qualitative data were analysed using reflexive thematic analysis.</p><p><strong>Results: </strong>Consumer participants (n=16) were aged between 62 and 83 years and were of mixed gender. The overarching theme was related to trust in the use of EHR data for research; themes included: (1) benefits of sharing data, (2) uncertainty around data collection processes and (3) data sharing fears. The three themes within the overarching theme all reflect participants' levels of trust.</p><p><strong>Conclusion: </strong>Our study identified fundamental issues related to trust in the use of EHR data for research, with both healthcare and broader societal factors contributing to consumer attitudes. Processes to support transparent and clear communication with consumers are essential to support the responsible use of EHR data for research.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"32 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751950/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142926462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Annisa Ristya Rahmanti, Usman Iqbal, Sandeep Reddy, Xiaohong W Gao, Huan Xuan Nguyen, Yu-Chuan Jack Li
{"title":"Generative artificial intelligence (AI): a key innovation or just hype in primary care settings?","authors":"Annisa Ristya Rahmanti, Usman Iqbal, Sandeep Reddy, Xiaohong W Gao, Huan Xuan Nguyen, Yu-Chuan Jack Li","doi":"10.1136/bmjhci-2024-101367","DOIUrl":"10.1136/bmjhci-2024-101367","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751819/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142909246","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Correction: Development of a scoring system to quantify errors from semantic characteristics in incident reports.","authors":"","doi":"10.1136/bmjhci-2023-100935.corr1","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100935.corr1","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142884984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tingting Lu, Ruihua Cao, Yujia Wang, Xiaoxuan Kong, Huiquan Wang, Guanghua Sun, Shan Gao, Yabin Wang, Yuan Yuan, Xiaoying Shen, Li Fan, Jun Ren, Feng Cao
{"title":"Wearable equipment-based telemedical management via multiparameter monitoring on cardiovascular outcomes in elderly patients with chronic coronary heart disease: an open-labelled, randomised, controlled trial.","authors":"Tingting Lu, Ruihua Cao, Yujia Wang, Xiaoxuan Kong, Huiquan Wang, Guanghua Sun, Shan Gao, Yabin Wang, Yuan Yuan, Xiaoying Shen, Li Fan, Jun Ren, Feng Cao","doi":"10.1136/bmjhci-2024-101135","DOIUrl":"10.1136/bmjhci-2024-101135","url":null,"abstract":"<p><strong>Background: </strong>The prevalence of chronic coronary heart diseases (CHDs) increases with age in the elderly, which represents one of the top-ranked causes of death and disease burden.</p><p><strong>Methods: </strong>This study aimed to investigate the management efficiency of telemedicine based on the remote multiparameter monitoring in elderly patients with CHD. A total of 1248 elderly patients diagnosed with CHD were enrolled. The subjects were randomly divided into two groups, wearable equipment-based telemedical management (WTM) group and traditional follow-up management (TFM) group. Face-to-face clinical interview at least once every 2 months was required in TFM group to collect the medical records. Patients in WTM group were provided with wearable equipment to complete remote monitoring, real-time alerts and health intervention via virtual consultations and remote medication recommendations.</p><p><strong>Results: </strong>The mean age of patients in WTM group and TFM group was 71.1 (68.0-82.0) years and 71.0 (68.0-81.0) years, respectively. After a 12-month management, patients in WTM group presented a lower occurrence of hospitalisation (HR 0.59, 95% CI=0.47 to 0.73, p<0.0001) and major adverse cardiac events (HR 0.60, 95% CI=0.44 to 0.82, p=0.0012) compared with patients in TFM group.</p><p><strong>Conclusion: </strong>The multiparameter telemedical management could help with the out-of-hospital management and reduce the incidence of rehospitalisation in elderly patients with CHD.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11647296/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Oliver J Canfell, Wilkin Chan, Jason D Pole, Teyl Engstrom, Tim Saul, Jacqueline Daly, Clair Sullivan
{"title":"Artificial intelligence after the bedside: co-design of AI-based clinical informatics workflows to routinely analyse patient-reported experience measures in hospitals.","authors":"Oliver J Canfell, Wilkin Chan, Jason D Pole, Teyl Engstrom, Tim Saul, Jacqueline Daly, Clair Sullivan","doi":"10.1136/bmjhci-2024-101124","DOIUrl":"10.1136/bmjhci-2024-101124","url":null,"abstract":"<p><strong>Objective: </strong>To co-design artificial intelligence (AI)-based clinical informatics workflows to routinely analyse patient-reported experience measures (PREMs) in hospitals.</p><p><strong>Methods: </strong>The context was public hospitals (n=114) and health services (n=16) in a large state in Australia serving a population of ~5 million. We conducted a participatory action research study with multidisciplinary healthcare professionals, managers, data analysts, consumer representatives and industry professionals (n=16) across three phases: (1) defining the problem, (2) current workflow and co-designing a future workflow and (3) developing proof-of-concept AI-based workflows. Co-designed workflows were deductively mapped to a validated feasibility framework to inform future clinical piloting. Qualitative data underwent inductive thematic analysis.</p><p><strong>Results: </strong>Between 2020 and 2022 (n=16 health services), 175 282 PREMs inpatient surveys received 23 982 open-ended responses (mean response rate, 13.7%). Existing PREMs workflows were problematic due to overwhelming data volume, analytical limitations, poor integration with health service workflows and inequitable resource distribution. Three potential semiautomated, AI-based (unsupervised machine learning) workflows were developed to address the identified problems: (1) no code (simple reports, no analytics), (2) low code (PowerBI dashboard, descriptive analytics) and (3) high code (Power BI dashboard, descriptive analytics, clinical unit-level interactive reporting).</p><p><strong>Discussion: </strong>The manual analysis of free-text PREMs data is laborious and difficult at scale. Automating analysis with AI could sharpen the focus on consumer input and accelerate quality improvement cycles in hospitals. Future research should investigate how AI-based workflows impact healthcare quality and safety.</p><p><strong>Conclusion: </strong>AI-based clinical informatics workflows to routinely analyse free-text PREMs data were co-designed with multidisciplinary end-users and are ready for clinical piloting.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11628959/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142799317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wilson Leung, Simon Ching Lam, Fowie Ng, Calvin Chi Kong Yip, Chi-Keung Chan
{"title":"Effectiveness of chatbot-based interventions on mental well-being of the general population in Asia: protocol for a systematic review and meta-analysis of randomised controlled trials.","authors":"Wilson Leung, Simon Ching Lam, Fowie Ng, Calvin Chi Kong Yip, Chi-Keung Chan","doi":"10.1136/bmjhci-2024-101148","DOIUrl":"10.1136/bmjhci-2024-101148","url":null,"abstract":"<p><strong>Introduction: </strong>In Asian countries, stigma against psychiatric disorders and shortage of manpower are the two major challenges that hinder people from receiving treatments. Chatbots can surely help people surpass the stigmatising and manpower shortage challenges. Since a comprehensive review in the Asian context is lacking, this systematic review will evaluate the effects of chatbot interventions on the mental well-being of the general population in Asia.</p><p><strong>Methods and analysis: </strong>Four electronic databases (PubMed, CINAHL, PsycINFO and MEDLINE) will be searched until December 2024. Randomised controlled trials with English/Chinese full text available will be included. Random-effect models will be used for meta-analyses. The risk of bias (RoB) and certainty of evidence across studies will be assessed using the Cochrane RoB2 and Grading of Recommendation Assessment, Development and Evaluation tools, respectively.</p><p><strong>Ethics and dissemination: </strong>This study will not require ethical approval. The findings will be disseminated through peer-reviewed publications.</p><p><strong>Funding: </strong>School Research Grant of the Tung Wah College (2023-04-52-SRG230401) PROSPERO REGISTRATION NUMBER: CRD42024546316.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11628986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142791087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Praveen M Yogendra, Adriel Guang Wei Goh, Sze Ying Yee, Freda Jawan, Kelvin Kay Nguan Koh, Timothy Shao Ern Tan, Tian Kai Woon, Phey Ming Yeap, Min On Tan
{"title":"Accuracy of radiologists and radiology residents in detection of paediatric appendicular fractures with and without artificial intelligence.","authors":"Praveen M Yogendra, Adriel Guang Wei Goh, Sze Ying Yee, Freda Jawan, Kelvin Kay Nguan Koh, Timothy Shao Ern Tan, Tian Kai Woon, Phey Ming Yeap, Min On Tan","doi":"10.1136/bmjhci-2024-101091","DOIUrl":"10.1136/bmjhci-2024-101091","url":null,"abstract":"<p><strong>Objectives: </strong>We aim to evaluate the accuracy of radiologists and radiology residents in the detection of paediatric appendicular fractures with and without the help of a commercially available fracture detection artificial intelligence (AI) solution in the hopes of showing potential clinical benefits in a general hospital setting.</p><p><strong>Methods: </strong>This was a retrospective study involving three associate consultants (AC) and three senior residents (SR) in radiology, who acted as readers. One reader from each human group interpreted the radiographs with the aid of AI. Cases were categorised into concordant and discordant cases between each interpreting group. Discordant cases were further evaluated by three independent subspecialty radiology consultants to determine the final diagnosis. A total of 500 anonymised paediatric patient cases (aged 2-15 years) who presented to a tertiary general hospital with a Children's emergency were retrospectively collected. Main outcome measures include the presence of fracture, accuracy of readers with and without AI, and total time taken to interpret the radiographs.</p><p><strong>Results: </strong>The AI solution alone showed the highest accuracy (area under the receiver operating characteristic curve 0.97; AC: 95% CI -0.055 to 0.320, p=0; SR: 95% CI 0.244 to 0.598, p=0). The two readers aided with AI had higher area under curves compared with readers without AI support (AC: 95% CI -0.303 to 0.465, p=0; SR: 95% CI -0.154 to 0.331, p=0). These differences were statistically significant.</p><p><strong>Conclusion: </strong>Our study demonstrates excellent results in the detection of paediatric appendicular fractures using a commercially available AI solution. There is potential for the AI solution to function autonomously.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624698/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142784004","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}