Roya Vesal Azad, Nosrat Riahinia, Ali Azimi, Hamid Baradaran
{"title":"Methodological and Systematic Errors in Systematic Reviews in Health Domain: A Systematic Review.","authors":"Roya Vesal Azad, Nosrat Riahinia, Ali Azimi, Hamid Baradaran","doi":"10.47176/mjiri.39.64","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>According to the pyramid of evidence, systematic reviews hold the highest position among studies used in healthcare systems and policy-making. Avoiding systematic and methodological errors are demanding responsibility for authors. Clearly, erroneous studies can have irreparable consequences on health and treatment decisions. Therefore, this study aims to identify potential errors in systematic reviews within the field of health.</p><p><strong>Methods: </strong>To systematically identify potential errors in systematic reviews, we conducted a comprehensive literature search using keywords such as \"Bias,\" \"Error,\" and \"Systematic Reviews\" across databases like PubMed, Web of Science, Scopus, Embase, Cochrane Library, and ProQuest without any time restrictions. This yielded 2333 articles and 11 books initially.After removing duplicates and unrelated sources based on predefined inclusion/exclusion criteria tailored for this study context (e.g., relevance to error identification in systematic reviews), we closely examined 88 relevant sources.</p><p><strong>Results: </strong>Upon analyzing the full texts of these sources with strict adherence to our criteria, we identified 77 distinct types of errors that could occur either within or between studies. These findings highlight the complexity of maintaining accuracy in systematic review methodologies.</p><p><strong>Conclusion: </strong>Given the critical role systemic reviews play in informing clinical decisions and health policies, ensuring their quality is paramount. Accurate methodology ensures validity; biased studies risk leading to suboptimal patient care outcomes. By pinpointing error sources-such as selection bias or information bias-and implementing strategies to mitigate them through rigorous methodologies like robust search protocols or transparent reporting standards (e.g., PRISMA guidelines), researchers can enhance review quality significantly.</p>","PeriodicalId":18361,"journal":{"name":"Medical Journal of the Islamic Republic of Iran","volume":"39 ","pages":"64"},"PeriodicalIF":0.0000,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12309345/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Journal of the Islamic Republic of Iran","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.47176/mjiri.39.64","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
Background: According to the pyramid of evidence, systematic reviews hold the highest position among studies used in healthcare systems and policy-making. Avoiding systematic and methodological errors are demanding responsibility for authors. Clearly, erroneous studies can have irreparable consequences on health and treatment decisions. Therefore, this study aims to identify potential errors in systematic reviews within the field of health.
Methods: To systematically identify potential errors in systematic reviews, we conducted a comprehensive literature search using keywords such as "Bias," "Error," and "Systematic Reviews" across databases like PubMed, Web of Science, Scopus, Embase, Cochrane Library, and ProQuest without any time restrictions. This yielded 2333 articles and 11 books initially.After removing duplicates and unrelated sources based on predefined inclusion/exclusion criteria tailored for this study context (e.g., relevance to error identification in systematic reviews), we closely examined 88 relevant sources.
Results: Upon analyzing the full texts of these sources with strict adherence to our criteria, we identified 77 distinct types of errors that could occur either within or between studies. These findings highlight the complexity of maintaining accuracy in systematic review methodologies.
Conclusion: Given the critical role systemic reviews play in informing clinical decisions and health policies, ensuring their quality is paramount. Accurate methodology ensures validity; biased studies risk leading to suboptimal patient care outcomes. By pinpointing error sources-such as selection bias or information bias-and implementing strategies to mitigate them through rigorous methodologies like robust search protocols or transparent reporting standards (e.g., PRISMA guidelines), researchers can enhance review quality significantly.
背景:根据证据金字塔,在医疗保健系统和政策制定中使用的研究中,系统评价占据最高地位。避免系统和方法上的错误要求作者承担责任。显然,错误的研究可能对健康和治疗决策造成无法弥补的后果。因此,本研究旨在确定卫生领域系统评价中的潜在错误。方法:为了系统地识别系统评价中的潜在错误,我们在PubMed、Web of Science、Scopus、Embase、Cochrane Library和ProQuest等数据库中使用“Bias”、“Error”和“systematic reviews”等关键词进行了全面的文献检索,没有任何时间限制。最初产生了2333篇文章和11本书。在根据为本研究量身定制的预定义的纳入/排除标准(例如,与系统评价中错误识别的相关性)去除重复和不相关的来源后,我们仔细检查了88个相关来源。结果:在严格遵守我们的标准分析这些来源的全文后,我们确定了77种不同类型的错误,这些错误可能发生在研究内部或研究之间。这些发现突出了在系统评价方法中保持准确性的复杂性。结论:鉴于系统评价在告知临床决策和卫生政策方面发挥的关键作用,确保其质量至关重要。准确的方法保证了有效性;有偏见的研究可能导致患者护理结果不理想。通过精确定位错误来源,如选择偏差或信息偏差,并通过严格的方法,如健全的搜索协议或透明的报告标准(如PRISMA指南),实施减轻错误的策略,研究人员可以显著提高评审质量。