{"title":"Making an organisation for health technology assessment: lessons from India.","authors":"Victoria Y Fan, Abha Mehndiratta, Jubilee Ahazie","doi":"10.1136/bmjebm-2023-112484","DOIUrl":"https://doi.org/10.1136/bmjebm-2023-112484","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":5.8,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140130615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adrian Gheorghe, Abha Mehndiratta, Peter Baker, Sophie Gulliver, Malkeet Singh, Kirti Tyagi, Javier Guzman
{"title":"Measuring progress in institutionalising evidence-informed priority-setting in the Indian healthcare system: an application using the iProSE scale.","authors":"Adrian Gheorghe, Abha Mehndiratta, Peter Baker, Sophie Gulliver, Malkeet Singh, Kirti Tyagi, Javier Guzman","doi":"10.1136/bmjebm-2023-112485","DOIUrl":"https://doi.org/10.1136/bmjebm-2023-112485","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":5.8,"publicationDate":"2024-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140064786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bashar Hasan, Samer Saadi, Noora S Rajjoub, Moustafa Hegazi, Mohammad Al-Kordi, Farah Fleti, Magdoleen Farah, Irbaz B Riaz, Imon Banerjee, Zhen Wang, Mohammad Hassan Murad
{"title":"Integrating large language models in systematic reviews: a framework and case study using ROBINS-I for risk of bias assessment","authors":"Bashar Hasan, Samer Saadi, Noora S Rajjoub, Moustafa Hegazi, Mohammad Al-Kordi, Farah Fleti, Magdoleen Farah, Irbaz B Riaz, Imon Banerjee, Zhen Wang, Mohammad Hassan Murad","doi":"10.1136/bmjebm-2023-112597","DOIUrl":"https://doi.org/10.1136/bmjebm-2023-112597","url":null,"abstract":"Large language models (LLMs) may facilitate and expedite systematic reviews, although the approach to integrate LLMs in the review process is unclear. This study evaluates GPT-4 agreement with human reviewers in assessing the risk of bias using the Risk Of Bias In Non-randomised Studies of Interventions (ROBINS-I) tool and proposes a framework for integrating LLMs into systematic reviews. The case study demonstrated that raw per cent agreement was the highest for the ROBINS-I domain of ‘Classification of Intervention’. Kendall agreement coefficient was highest for the domains of ‘Participant Selection’, ‘Missing Data’ and ‘Measurement of Outcomes’, suggesting moderate agreement in these domains. Raw agreement about the overall risk of bias across domains was 61% (Kendall coefficient=0.35). The proposed framework for integrating LLMs into systematic reviews consists of four domains: rationale for LLM use, protocol (task definition, model selection, prompt engineering, data entry methods, human role and success metrics), execution (iterative revisions to the protocol) and reporting. We identify five basic task types relevant to systematic reviews: selection, extraction, judgement, analysis and narration. Considering the agreement level with a human reviewer in the case study, pairing artificial intelligence with an independent human reviewer remains required. Data are available upon reasonable request. Search strategy, selection process flowchart, prompts and boxes containing included SRs and studies are available in the appendix. Analysed datasheet is available upon request.","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":"180 1","pages":""},"PeriodicalIF":5.8,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139918110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adrian Gheorghe, Abha Mehndiratta, Peter Baker, Anthony Culyer, Shankar Prinja, Sitanshu Sekhar Kar, Javier Guzman
{"title":"Health technology assessment in India in the next decade: reflections on a vision for its path to maturity and impact.","authors":"Adrian Gheorghe, Abha Mehndiratta, Peter Baker, Anthony Culyer, Shankar Prinja, Sitanshu Sekhar Kar, Javier Guzman","doi":"10.1136/bmjebm-2023-112491","DOIUrl":"https://doi.org/10.1136/bmjebm-2023-112491","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":""},"PeriodicalIF":5.8,"publicationDate":"2024-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139641591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Daniel G Hamilton, Sarah Everitt, Matthew J Page, Simine Vazire, Fiona Fidler
{"title":"Attitudes of people living with cancer towards trial non-publication and research participation.","authors":"Daniel G Hamilton, Sarah Everitt, Matthew J Page, Simine Vazire, Fiona Fidler","doi":"10.1136/bmjebm-2023-112456","DOIUrl":"10.1136/bmjebm-2023-112456","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"64-66"},"PeriodicalIF":5.8,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10492430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Setting new research in the context of previous research: some options.","authors":"Paul Glasziou, Mark Jones, Mike Clarke","doi":"10.1136/bmjebm-2023-112300","DOIUrl":"10.1136/bmjebm-2023-112300","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"44-46"},"PeriodicalIF":5.8,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10850654/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9680143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mille Falk Bjørch, Emma Grundtvig Gram, John Brandt Brodersen
{"title":"Overdiagnosis in malignant melanoma: a scoping review.","authors":"Mille Falk Bjørch, Emma Grundtvig Gram, John Brandt Brodersen","doi":"10.1136/bmjebm-2023-112341","DOIUrl":"10.1136/bmjebm-2023-112341","url":null,"abstract":"<p><strong>Objectives: </strong>We aimed to systematically identify and scrutinise published empirical evidence about overdiagnosis in malignant melanoma and examine how frequent overdiagnosis of melanoma is and whether this is related to different types of interventions or diagnostic technologies.</p><p><strong>Design and setting: </strong>Empirical studies that discussed overdiagnosis in malignant melanoma were eligible, including qualitative and quantitative studies in any type of population, age group and geographical location. We excluded studies that did not include empirical data, studies that only mentioned 'overdiagnosis' without addressing it further and studies that used the term overdiagnosis for cases of misdiagnosis or false positives.We developed the search strategy in cooperation with an information specialist. We searched five databases on 21 April 2022: MEDLINE, Embase, CINAHL, PsycINFO and Cochrane Library.This scoping review adheres to The JBI methodology and Prefered Reporting Items for Systematic Reviews and Meta-analyses extension for Scoping reviews (PRISMA-ScR). Two reviewers independently screened titles, abstracts and full texts for inclusion and extracted data from the included studies. The data extracted include study characteristics, population details, research question, the context and the study's main results.</p><p><strong>Results: </strong>Our search resulted in 1134 potentially relevant studies. 35 studies were included: 29 register studies, 3 cohort studies, 1 case-control study, 1 survey study and 1 randomised controlled trial. Most register studies examined trends in melanoma incidence and/or mortality and found a significant increase in incidence between 0.39% and 6.6% annually and a little or no increase in mortality. Three cohort studies and one case-control study showed that skin screening was associated with increased detection of melanoma; especially in situ or thin invasive melanoma. Three studies estimated the degree of overdiagnosis which ranged from 29% to 60%.</p><p><strong>Conclusions: </strong>Epidemiological data suggest a high degree of overdiagnosis in malignant melanoma. Studies that examined the association between skin screening and malignant melanoma all found increased detection of melanomas, mostly thin and in situ melanomas, which raises concern about overdiagnosis.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"17-28"},"PeriodicalIF":5.8,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41108143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Omid Kohandel Gargari, Mohammad Hossein Mahmoudi, Mahsa Hajisafarali, Reza Samiee
{"title":"Enhancing title and abstract screening for systematic reviews with GPT-3.5 turbo.","authors":"Omid Kohandel Gargari, Mohammad Hossein Mahmoudi, Mahsa Hajisafarali, Reza Samiee","doi":"10.1136/bmjebm-2023-112678","DOIUrl":"10.1136/bmjebm-2023-112678","url":null,"abstract":"","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"69-70"},"PeriodicalIF":5.8,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10850650/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138290246","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chantelle Garritty, Andrea C Tricco, Maureen Smith, Danielle Pollock, Chris Kamel, Valerie J King
{"title":"Rapid Reviews Methods Series: Involving patient and public partners, healthcare providers and policymakers as knowledge users.","authors":"Chantelle Garritty, Andrea C Tricco, Maureen Smith, Danielle Pollock, Chris Kamel, Valerie J King","doi":"10.1136/bmjebm-2022-112070","DOIUrl":"10.1136/bmjebm-2022-112070","url":null,"abstract":"<p><p>Rapid reviews (RRs) are a helpful evidence synthesis tool to support urgent and emergent decision-making in healthcare. RRs involve abbreviating systematic review methods and are conducted in a condensed timeline to meet the decision-making needs of organisations or groups that commission them. Knowledge users (KUs) are those individuals, typically patient and public partners, healthcare providers, and policy-makers, who are likely to use evidence from research, including RRs, to make informed decisions about health policies, programmes or practices. However, research suggests that KU involvement in RRs is often limited or overlooked, and few RRs include patients as KUs. Existing RR methods guidance advocates involving KUs but lacks detailed steps on how and when to do so. This paper discusses the importance of involving KUs in RRs, including patient and public involvement to ensure RRs are fit for purpose and relevant for decision-making. Opportunities to involve KUs in planning, conduct and knowledge translation of RRs are outlined. Further, this paper describes various modes of engaging KUs during the review lifecycle; key considerations researchers should be mindful of when involving distinct KU groups; and an exemplar case study demonstrating substantive involvement of patient partners and the public in developing RRs. Although involving KUs requires time, resources and expertise, researchers should strive to balance 'rapid' with meaningful KU involvement in RRs. This paper is the first in a series led by the Cochrane Rapid Reviews Methods Group to further guide general RR methods.</p>","PeriodicalId":9059,"journal":{"name":"BMJ Evidence-Based Medicine","volume":" ","pages":"55-61"},"PeriodicalIF":5.8,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10850627/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9425776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}