Jens Declerck, Bert Vandenberk, Mieke Deschepper, Kirsten Colpaert, Lieselot Cool, Jens Goemaere, Mona Bové, Frank Staelens, Koen De Meester, Eva Verbeke, Elke Smits, Cami De Decker, Nicky Van Der Vekens, Elin Pauwels, Robert Vander Stichele, Dipak Kalra, Pascal Coorevits
{"title":"Building a Foundation for High-Quality Health Data: Multihospital Case Study in Belgium.","authors":"Jens Declerck, Bert Vandenberk, Mieke Deschepper, Kirsten Colpaert, Lieselot Cool, Jens Goemaere, Mona Bové, Frank Staelens, Koen De Meester, Eva Verbeke, Elke Smits, Cami De Decker, Nicky Van Der Vekens, Elin Pauwels, Robert Vander Stichele, Dipak Kalra, Pascal Coorevits","doi":"10.2196/60244","DOIUrl":"10.2196/60244","url":null,"abstract":"<p><strong>Background: </strong>Data quality is fundamental to maintaining the trust and reliability of health data for both primary and secondary purposes. However, before the secondary use of health data, it is essential to assess the quality at the source and to develop systematic methods for the assessment of important data quality dimensions.</p><p><strong>Objective: </strong>This case study aims to offer a dual aim-to assess the data quality of height and weight measurements across 7 Belgian hospitals, focusing on the dimensions of completeness and consistency, and to outline the obstacles these hospitals face in sharing and improving data quality standards.</p><p><strong>Methods: </strong>Focusing on data quality dimensions completeness and consistency, this study examined height and weight data collected from 2021 to 2022 within 3 distinct departments-surgical, geriatrics, and pediatrics-in each of the 7 hospitals.</p><p><strong>Results: </strong>Variability was observed in the completeness scores for height across hospitals and departments, especially within surgical and geriatric wards. In contrast, weight data uniformly achieved high completeness scores. Notably, the consistency of height and weight data recording was uniformly high across all departments.</p><p><strong>Conclusions: </strong>A collective collaboration among Belgian hospitals, transcending network affiliations, was formed to conduct this data quality assessment. This study demonstrates the potential for improving data quality across health care organizations by sharing knowledge and good practices, establishing a foundation for future, similar research.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e60244"},"PeriodicalIF":3.1,"publicationDate":"2024-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11683741/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142900937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sanghwan Kim, Sowon Jang, Borham Kim, Leonard Sunwoo, Seok Kim, Jin-Haeng Chung, Sejin Nam, Hyeongmin Cho, Donghyoung Lee, Keehyuck Lee, Sooyoung Yoo
{"title":"Automated Pathologic TN Classification Prediction and Rationale Generation From Lung Cancer Surgical Pathology Reports Using a Large Language Model Fine-Tuned With Chain-of-Thought: Algorithm Development and Validation Study.","authors":"Sanghwan Kim, Sowon Jang, Borham Kim, Leonard Sunwoo, Seok Kim, Jin-Haeng Chung, Sejin Nam, Hyeongmin Cho, Donghyoung Lee, Keehyuck Lee, Sooyoung Yoo","doi":"10.2196/67056","DOIUrl":"10.2196/67056","url":null,"abstract":"<p><strong>Background: </strong>Traditional rule-based natural language processing approaches in electronic health record systems are effective but are often time-consuming and prone to errors when handling unstructured data. This is primarily due to the substantial manual effort required to parse and extract information from diverse types of documentation. Recent advancements in large language model (LLM) technology have made it possible to automatically interpret medical context and support pathologic staging. However, existing LLMs encounter challenges in rapidly adapting to specialized guideline updates. In this study, we fine-tuned an LLM specifically for lung cancer pathologic staging, enabling it to incorporate the latest guidelines for pathologic TN classification.</p><p><strong>Objective: </strong>This study aims to evaluate the performance of fine-tuned generative language models in automatically inferring pathologic TN classifications and extracting their rationale from lung cancer surgical pathology reports. By addressing the inefficiencies and extensive parsing efforts associated with rule-based methods, this approach seeks to enable rapid and accurate reclassification aligned with the latest cancer staging guidelines.</p><p><strong>Methods: </strong>We conducted a comparative performance evaluation of 6 open-source LLMs for automated TN classification and rationale generation, using 3216 deidentified lung cancer surgical pathology reports based on the American Joint Committee on Cancer (AJCC) Cancer Staging Manual8th edition, collected from a tertiary hospital. The dataset was preprocessed by segmenting each report according to lesion location and morphological diagnosis. Performance was assessed using exact match ratio (EMR) and semantic match ratio (SMR) as evaluation metrics, which measure classification accuracy and the contextual alignment of the generated rationales, respectively.</p><p><strong>Results: </strong>Among the 6 models, the Orca2_13b model achieved the highest performance with an EMR of 0.934 and an SMR of 0.864. The Orca2_7b model also demonstrated strong performance, recording an EMR of 0.914 and an SMR of 0.854. In contrast, the Llama2_7b model achieved an EMR of 0.864 and an SMR of 0.771, while the Llama2_13b model showed an EMR of 0.762 and an SMR of 0.690. The Mistral_7b and Llama3_8b models, on the other hand, showed lower performance, with EMRs of 0.572 and 0.489, and SMRs of 0.377 and 0.456, respectively. Overall, the Orca2 models consistently outperformed the others in both TN stage classification and rationale generation.</p><p><strong>Conclusions: </strong>The generative language model approach presented in this study has the potential to enhance and automate TN classification in complex cancer staging, supporting both clinical practice and oncology data curation. With additional fine-tuning based on cancer-specific guidelines, this approach can be effectively adapted to other cancer types.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e67056"},"PeriodicalIF":3.1,"publicationDate":"2024-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11699504/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142869650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Automatic and End-to-End System for Rare Disease Knowledge Graph Construction Based on Ontology-Enhanced Large Language Models: Development Study.","authors":"Lang Cao, Jimeng Sun, Adam Cross","doi":"10.2196/60665","DOIUrl":"10.2196/60665","url":null,"abstract":"<p><strong>Background: </strong>Rare diseases affect millions worldwide but sometimes face limited research focus individually due to low prevalence. Many rare diseases do not have specific International Classification of Diseases, Ninth Edition (ICD-9) and Tenth Edition (ICD-10), codes and therefore cannot be reliably extracted from granular fields like \"Diagnosis\" and \"Problem List\" entries, which complicates tasks that require identification of patients with these conditions, including clinical trial recruitment and research efforts. Recent advancements in large language models (LLMs) have shown promise in automating the extraction of medical information, offering the potential to improve medical research, diagnosis, and management. However, most LLMs lack professional medical knowledge, especially concerning specific rare diseases, and cannot effectively manage rare disease data in its various ontological forms, making it unsuitable for these tasks.</p><p><strong>Objective: </strong>Our aim is to create an end-to-end system called automated rare disease mining (AutoRD), which automates the extraction of rare disease-related information from medical text, focusing on entities and their relations to other medical concepts, such as signs and symptoms. AutoRD integrates up-to-date ontologies with other structured knowledge and demonstrates superior performance in rare disease extraction tasks. We conducted various experiments to evaluate AutoRD's performance, aiming to surpass common LLMs and traditional methods.</p><p><strong>Methods: </strong>AutoRD is a pipeline system that involves data preprocessing, entity extraction, relation extraction, entity calibration, and knowledge graph construction. We implemented this system using GPT-4 and medical knowledge graphs developed from the open-source Human Phenotype and Orphanet ontologies, using techniques such as chain-of-thought reasoning and prompt engineering. We quantitatively evaluated our system's performance in entity extraction, relation extraction, and knowledge graph construction. The experiment used the well-curated dataset RareDis2023, which contains medical literature focused on rare disease entities and their relations, making it an ideal dataset for training and testing our methodology.</p><p><strong>Results: </strong>On the RareDis2023 dataset, AutoRD achieved an overall entity extraction F1-score of 56.1% and a relation extraction F1-score of 38.6%, marking a 14.4% improvement over the baseline LLM. Notably, the F1-score for rare disease entity extraction reached 83.5%, indicating high precision and recall in identifying rare disease mentions. These results demonstrate the effectiveness of integrating LLMs with medical ontologies in extracting complex rare disease information.</p><p><strong>Conclusions: </strong>AutoRD is an automated end-to-end system for extracting rare disease information from text to build knowledge graphs, addressing critical limitations of existing LLMs by impr","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e60665"},"PeriodicalIF":3.1,"publicationDate":"2024-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11683654/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142856735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Felix Patricius Hans, Jan Kleinekort, Melanie Boerries, Alexandra Nieters, Gerhard Kindle, Micha Rautenberg, Laura Bühler, Gerda Weiser, Michael Clemens Röttger, Carolin Neufischer, Matthias Kühn, Julius Wehrle, Anna Slagman, Antje Fischer-Rosinsky, Larissa Eienbröker, Frank Hanses, Gisbert Wilhelm Teepe, Hans-Jörg Busch, Leo Benning
{"title":"Information Mode-Dependent Success Rates of Obtaining German Medical Informatics Initiative-Compliant Broad Consent in the Emergency Department: Single-Center Prospective Observational Study.","authors":"Felix Patricius Hans, Jan Kleinekort, Melanie Boerries, Alexandra Nieters, Gerhard Kindle, Micha Rautenberg, Laura Bühler, Gerda Weiser, Michael Clemens Röttger, Carolin Neufischer, Matthias Kühn, Julius Wehrle, Anna Slagman, Antje Fischer-Rosinsky, Larissa Eienbröker, Frank Hanses, Gisbert Wilhelm Teepe, Hans-Jörg Busch, Leo Benning","doi":"10.2196/65646","DOIUrl":"10.2196/65646","url":null,"abstract":"<p><strong>Background: </strong>The broad consent (BC) developed by the German Medical Informatics Initiative is a pivotal national strategy for obtaining patient consent to use routinely collected data from electronic health records, insurance companies, contact information, and biomaterials for research. Emergency departments (EDs) are ideal for enrolling diverse patient populations in research activities. Despite regulatory and ethical challenges, obtaining BC from patients in ED with varying demographic, socioeconomic, and disease characteristics presents a promising opportunity to expand the availability of ED data.</p><p><strong>Objective: </strong>This study aimed to evaluate the success rate of obtaining BC through different consenting approaches in a tertiary ED and to explore factors influencing consent and dropout rates.</p><p><strong>Methods: </strong>A single-center prospective observational study was conducted in a German tertiary ED from September to December 2022. Every 30th patient was screened for eligibility. Eligible patients were informed via one of three modalities: (1) directly in the ED, (2) during their inpatient stay on the ward, or (3) via telephone after discharge. The primary outcome was the success rate of obtaining BC within 30 days of ED presentation. Secondary outcomes included analyzing potential influences on the success and dropout rates based on patient characteristics, information mode, and the interaction time required for patients to make an informed decision.</p><p><strong>Results: </strong>Of 11,842 ED visits, 419 patients were screened for BC eligibility, with 151 meeting the inclusion criteria. Of these, 68 (45%) consented to at least 1 BC module, while 24 (15.9%) refused participation. The dropout rate was 39.1% (n=59) and was highest in the telephone-based group (57/109, 52.3%) and lowest in the ED group (1/14, 7.1%). Patients informed face-to-face during their inpatient stay following the ED treatment had the highest consent rate (23/27, 85.2%), while those approached in the ED or by telephone had consent rates of 69.2% (9/13 and 36/52). Logistic regression analysis indicated that longer interaction time significantly improved consent rates (P=.03), while female sex was associated with higher dropout rates (P=.02). Age, triage category, billing details (inpatient treatment), or diagnosis did not significantly influence the primary outcome (all P>.05).</p><p><strong>Conclusions: </strong>Obtaining BC in an ED environment is feasible, enabling representative inclusion of ED populations. However, discharge from the ED and female sex negatively affected consent rates to the BC. Face-to-face interaction proved most effective, particularly for inpatients, while telephone-based approaches resulted in higher dropout rates despite comparable consent rates to direct consenting in the ED. The findings underscore the importance of tailored consent strategies and maintaining consenting staff in EDs and on the war","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":" ","pages":"e65646"},"PeriodicalIF":3.1,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11688594/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142774995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Charlotte A W Albers, Yvonne Wieland-Jorna, Martine C de Bruijne, Martin Smalbrugge, Karlijn J Joling, Marike E de Boer
{"title":"Enhancing Standardized and Structured Recording by Elderly Care Physicians for Reusing Electronic Health Record Data: Interview Study.","authors":"Charlotte A W Albers, Yvonne Wieland-Jorna, Martine C de Bruijne, Martin Smalbrugge, Karlijn J Joling, Marike E de Boer","doi":"10.2196/63710","DOIUrl":"10.2196/63710","url":null,"abstract":"<p><strong>Background: </strong>Elderly care physicians (ECPs) in nursing homes document patients' health, medical conditions, and the care provided in electronic health records (EHRs). However, much of these health data currently lack structure and standardization, limiting their potential for health information exchange across care providers and reuse for quality improvement, policy development, and scientific research. Enhancing this potential requires insight into the attitudes and behaviors of ECPs toward standardized and structured recording in EHRs.</p><p><strong>Objective: </strong>This study aims to answer why and how ECPs record their findings in EHRs and what factors influence them to record in a standardized and structured manner. The findings will be used to formulate recommendations aimed at enhancing standardized and structured data recording for the reuse of EHR data.</p><p><strong>Methods: </strong>Semistructured interviews were conducted with 13 ECPs working in Dutch nursing homes. We recruited participants through purposive sampling, aiming for diversity in age, gender, health care organization, and use of EHR systems. Interviews continued until we reached data saturation. Analysis was performed using inductive thematic analysis.</p><p><strong>Results: </strong>ECPs primarily use EHRs to document daily patient care, ensure continuity of care, and fulfill their obligation to record specific information for accountability purposes. The EHR serves as a record to justify their actions in the event of a complaint. In addition, some respondents also mentioned recording information for secondary purposes, such as research and quality improvement. Several factors were found to influence standardized and structured recording. At a personal level, it is crucial to experience the added value of standardized and structured recording. At the organizational level, clear internal guidelines and a focus on their implementation can have a substantial impact. At the level of the EHR system, user-friendliness, interoperability, and guidance were most frequently mentioned as being important. At a national level, the alignment of internal guidelines with overarching standards plays a pivotal role in encouraging standardized and structured recording.</p><p><strong>Conclusions: </strong>The results of our study are similar to the findings of previous research in hospital care and general practice. Therefore, long-term care can learn from solutions regarding standardized and structured recording in other health care sectors. The main motives for ECPs to record in EHRs are the daily patient care and ensuring continuity of care. Standardized and structured recording can be improved by aligning the recording method in EHRs with the primary care process. In addition, there are incentives for motivating ECPs to record in a standardized and structured way, mainly at the personal, organizational, EHR system, and national levels.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e63710"},"PeriodicalIF":3.1,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11681280/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Survival After Radical Cystectomy for Bladder Cancer: Development of a Fair Machine Learning Model.","authors":"Samuel Carbunaru, Yassamin Neshatvar, Hyungrok Do, Katie Murray, Rajesh Ranganath, Madhur Nayan","doi":"10.2196/63289","DOIUrl":"10.2196/63289","url":null,"abstract":"<p><strong>Background: </strong>Prediction models based on machine learning (ML) methods are being increasingly developed and adopted in health care. However, these models may be prone to bias and considered unfair if they demonstrate variable performance in population subgroups. An unfair model is of particular concern in bladder cancer, where disparities have been identified in sex and racial subgroups.</p><p><strong>Objective: </strong>This study aims (1) to develop a ML model to predict survival after radical cystectomy for bladder cancer and evaluate for potential model bias in sex and racial subgroups; and (2) to compare algorithm unfairness mitigation techniques to improve model fairness.</p><p><strong>Methods: </strong>We trained and compared various ML classification algorithms to predict 5-year survival after radical cystectomy using the National Cancer Database. The primary model performance metric was the F<sub>1</sub>-score. The primary metric for model fairness was the equalized odds ratio (eOR). We compared 3 algorithm unfairness mitigation techniques to improve eOR.</p><p><strong>Results: </strong>We identified 16,481 patients; 23.1% (n=3800) were female, and 91.5% (n=15,080) were \"White,\" 5% (n=832) were \"Black,\" 2.3% (n=373) were \"Hispanic,\" and 1.2% (n=196) were \"Asian.\" The 5-year mortality rate was 75% (n=12,290). The best naive model was extreme gradient boosting (XGBoost), which had an F<sub>1</sub>-score of 0.860 and eOR of 0.619. All unfairness mitigation techniques increased the eOR, with correlation remover showing the highest increase and resulting in a final eOR of 0.750. This mitigated model had F<sub>1</sub>-scores of 0.86, 0.904, and 0.824 in the full, Black male, and Asian female test sets, respectively.</p><p><strong>Conclusions: </strong>The ML model predicting survival after radical cystectomy exhibited bias across sex and racial subgroups. By using algorithm unfairness mitigation techniques, we improved algorithmic fairness as measured by the eOR. Our study highlights the role of not only evaluating for model bias but also actively mitigating such disparities to ensure equitable health care delivery. We also deployed the first web-based fair ML model for predicting survival after radical cystectomy.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e63289"},"PeriodicalIF":3.1,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11694706/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Information Source Characteristics of Personal Data Leakage During the COVID-19 Pandemic in China: Observational Study.","authors":"Zhong Wang, Fangru Hu, Jie Su, Yuyao Lin","doi":"10.2196/51219","DOIUrl":"10.2196/51219","url":null,"abstract":"<p><strong>Background: </strong>During the COVID-19 pandemic, in the period of preventing and controlling the spread of the virus, a large amount of personal data was collected in China, and privacy leakage incidents occurred.</p><p><strong>Objective: </strong>We aimed to examine the information source characteristics of personal data leakage during the COVID-19 pandemic in China.</p><p><strong>Methods: </strong>We extracted information source characteristics of 40 personal data leakage cases using open coding and analyzed the data with 1D and 2D matrices.</p><p><strong>Results: </strong>In terms of organizational characteristics, data leakage cases mainly occurred in government agencies below the prefecture level, while few occurred in the medical system or in high-level government organizations. The majority of leakers were regular employees or junior staff members rather than temporary workers or senior managers. Family WeChat groups were the primary route for disclosure; the forwarding of documents was the main method of divulgence, while taking screenshots and pictures made up a comparatively smaller portion.</p><p><strong>Conclusions: </strong>We propose the following suggestions: restricting the authority of nonmedical institutions and low-level government agencies to collect data, strengthening training for low-level employees on privacy protection, and restricting the flow of data on social media through technical measures.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e51219"},"PeriodicalIF":3.1,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11651669/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142830943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Danielle Helminski, Jeremy B Sussman, Paul N Pfeiffer, Alex N Kokaly, Allison Ranusch, Anjana Deep Renji, Laura J Damschroder, Zach Landis-Lewis, Jacob E Kurlander
{"title":"Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review.","authors":"Danielle Helminski, Jeremy B Sussman, Paul N Pfeiffer, Alex N Kokaly, Allison Ranusch, Anjana Deep Renji, Laura J Damschroder, Zach Landis-Lewis, Jacob E Kurlander","doi":"10.2196/59828","DOIUrl":"10.2196/59828","url":null,"abstract":"<p><strong>Background: </strong>Dashboards have become ubiquitous in health care settings, but to achieve their goals, they must be developed, implemented, and evaluated using methods that help ensure they meet the needs of end users and are suited to the barriers and facilitators of the local context.</p><p><strong>Objective: </strong>This scoping review aimed to explore published literature on health care dashboards to characterize the methods used to identify factors affecting uptake, strategies used to increase dashboard uptake, and evaluation methods, as well as dashboard characteristics and context.</p><p><strong>Methods: </strong>MEDLINE, Embase, Web of Science, and the Cochrane Library were searched from inception through July 2020. Studies were included if they described the development or evaluation of a health care dashboard with publication from 2018-2020. Clinical setting, purpose (categorized as clinical, administrative, or both), end user, design characteristics, methods used to identify factors affecting uptake, strategies to increase uptake, and evaluation methods were extracted.</p><p><strong>Results: </strong>From 116 publications, we extracted data for 118 dashboards. Inpatient (45/118, 38.1%) and outpatient (42/118, 35.6%) settings were most common. Most dashboards had ≥2 stated purposes (84/118, 71.2%); of these, 54 of 118 (45.8%) were administrative, 43 of 118 (36.4%) were clinical, and 20 of 118 (16.9%) had both purposes. Most dashboards included frontline clinical staff as end users (97/118, 82.2%). To identify factors affecting dashboard uptake, half involved end users in the design process (59/118, 50%); fewer described formative usability testing (26/118, 22%) or use of any theory or framework to guide development, implementation, or evaluation (24/118, 20.3%). The most common strategies used to increase uptake included education (60/118, 50.8%); audit and feedback (59/118, 50%); and advisory boards (54/118, 45.8%). Evaluations of dashboards (84/118, 71.2%) were mostly quantitative (60/118, 50.8%), with fewer using only qualitative methods (6/118, 5.1%) or a combination of quantitative and qualitative methods (18/118, 15.2%).</p><p><strong>Conclusions: </strong>Most dashboards forego steps during development to ensure they suit the needs of end users and the clinical context; qualitative evaluation-which can provide insight into ways to improve dashboard effectiveness-is uncommon. Education and audit and feedback are frequently used to increase uptake. These findings illustrate the need for promulgation of best practices in dashboard development and will be useful to dashboard planners.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e59828"},"PeriodicalIF":3.1,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11651422/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142830920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mohammed A AboArab, Vassiliki T Potsika, Alexis Theodorou, Sylvia Vagena, Miltiadis Gravanis, Fragiska Sigala, Dimitrios I Fotiadis
{"title":"Advancing Progressive Web Applications to Leverage Medical Imaging for Visualization of Digital Imaging and Communications in Medicine and Multiplanar Reconstruction: Software Development and Validation Study.","authors":"Mohammed A AboArab, Vassiliki T Potsika, Alexis Theodorou, Sylvia Vagena, Miltiadis Gravanis, Fragiska Sigala, Dimitrios I Fotiadis","doi":"10.2196/63834","DOIUrl":"10.2196/63834","url":null,"abstract":"<p><strong>Background: </strong>In medical imaging, 3D visualization is vital for displaying volumetric organs, enhancing diagnosis and analysis. Multiplanar reconstruction (MPR) improves visual and diagnostic capabilities by transforming 2D images from computed tomography (CT) and magnetic resonance imaging into 3D representations. Web-based Digital Imaging and Communications in Medicine (DICOM) viewers integrated into picture archiving and communication systems facilitate access to pictures and interaction with remote data. However, the adoption of progressive web applications (PWAs) for web-based DICOM and MPR visualization remains limited. This paper addresses this gap by leveraging PWAs for their offline access and enhanced performance.</p><p><strong>Objective: </strong>This study aims to evaluate the integration of DICOM and MPR visualization into the web using PWAs, addressing challenges related to cross-platform compatibility, integration capabilities, and high-resolution image reconstruction for medical image visualization.</p><p><strong>Methods: </strong>Our paper introduces a PWA that uses a modular design for enhancing DICOM and MPR visualization in web-based medical imaging. By integrating React.js and Cornerstone.js, the application offers seamless DICOM image processing, ensures cross-browser compatibility, and delivers a responsive user experience across multiple devices. It uses advanced interpolation techniques to make volume reconstructions more accurate. This makes MPR analysis and visualization better in a web environment, thus promising a substantial advance in medical imaging analysis.</p><p><strong>Results: </strong>In our approach, the performance of DICOM- and MPR-based PWAs for medical image visualization and reconstruction was evaluated through comprehensive experiments. The application excelled in terms of loading time and volume reconstruction, particularly in Google Chrome, whereas Firefox showed superior performance in viewing slices. This study uses a dataset comprising 22 CT scans of peripheral artery patients to demonstrate the application's robust performance, with Google Chrome outperforming other browsers in both the local area network and wide area network settings. In addition, the application's accuracy in MPR reconstructions was validated with an error margin of <0.05 mm and outperformed the state-of-the-art methods by 84% to 98% in loading and volume rendering time.</p><p><strong>Conclusions: </strong>This paper highlights advancements in DICOM and MPR visualization using PWAs, addressing the gaps in web-based medical imaging. By exploiting PWA features such as offline access and improved performance, we have significantly advanced medical imaging technology, focusing on cross-platform compatibility, integration efficiency, and speed. Our application outperforms existing platforms for handling complex MPR analyses and accurate analysis of medical imaging as validated through peripheral artery CT imaging.","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e63834"},"PeriodicalIF":3.1,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11667143/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142803582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julian Varghese, Alexander Schuster, Broder Poschkamp, Kemal Yildirim, Johannes Oehm, Philipp Berens, Sarah Müller, Julius Gervelmeyer, Lisa Koch, Katja Hoffmann, Martin Sedlmayr, Vinodh Kakkassery, Oliver Kohlbacher, David Merle, Karl Ulrich Bartz-Schmidt, Marius Ueffing, Dana Stahl, Torsten Leddig, Martin Bialke, Christopher Hampf, Wolfgang Hoffmann, Sebastian Berthe, Dagmar Waltemath, Peter Walter, Myriam Lipprandt, Rainer Röhrig, Jens Julian Storp, Julian Alexander Zimmermann, Lea Holtrup, Tobias Brix, Andreas Stahl, Nicole Eter
{"title":"EyeMatics: An Ophthalmology Use Case Within the German Medical Informatics Initiative.","authors":"Julian Varghese, Alexander Schuster, Broder Poschkamp, Kemal Yildirim, Johannes Oehm, Philipp Berens, Sarah Müller, Julius Gervelmeyer, Lisa Koch, Katja Hoffmann, Martin Sedlmayr, Vinodh Kakkassery, Oliver Kohlbacher, David Merle, Karl Ulrich Bartz-Schmidt, Marius Ueffing, Dana Stahl, Torsten Leddig, Martin Bialke, Christopher Hampf, Wolfgang Hoffmann, Sebastian Berthe, Dagmar Waltemath, Peter Walter, Myriam Lipprandt, Rainer Röhrig, Jens Julian Storp, Julian Alexander Zimmermann, Lea Holtrup, Tobias Brix, Andreas Stahl, Nicole Eter","doi":"10.2196/60851","DOIUrl":"10.2196/60851","url":null,"abstract":"<p><strong>Unlabelled: </strong>The EyeMatics project, embedded as a clinical use case in Germany's Medical Informatics Initiative, is a large digital health initiative in ophthalmology. The objective is to improve the understanding of the treatment effects of intravitreal injections, the most frequent procedure to treat eye diseases. To achieve this, valuable patient data will be meaningfully integrated and visualized from different IT systems and hospital sites. EyeMatics emphasizes a governance framework that actively involves patient representatives, strictly implements interoperability standards, and employs artificial intelligence methods to extract biomarkers from tabular and clinical data as well as raw retinal scans. In this perspective paper, we delineate the strategies for user-centered implementation and health care-based evaluation in a multisite observational technology study.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"12 ","pages":"e60851"},"PeriodicalIF":3.1,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11637454/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142787867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}