Wilson Jiang, Bill Wang, Sandro Sperandei, Aidan Christopher Tan
{"title":"小儿外科随机对照试验和系统综述的质量:横断面荟萃研究","authors":"Wilson Jiang, Bill Wang, Sandro Sperandei, Aidan Christopher Tan","doi":"10.1002/cesm.12042","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>There are few randomized controlled trials (RCTs) in pediatric surgery, and their risk of bias is unknown. There is also little known about the methodological or reporting quality of systematic reviews (with or without meta-analyses) in pediatric surgery. Therefore, we conducted a cross-sectional meta-research study to determine the risk of bias and reporting quality of RCTs and systematic reviews and meta-analyses in pediatric surgery, and the associations between these outcomes and study characteristics.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>We searched MEDLINE, Embase, Cochrane Library, JBI EBP Database, Centre for Reviews and Dissemination and Web of Science for all RCTs and systematic reviews in pediatric surgery published in 2021. We also searched the 2021 indexes of high-impact pediatric surgery journals. We assessed the risk of bias and reporting quality of RCTs using the RoB 2 and CONSORT tools respectively. We assessed the same parameters for systematic reviews and meta-analyses using the ROBIS and Preferred Reporting Items for Systematic Reviews and Meta-analyses tools.</p>\n </section>\n \n <section>\n \n <h3> Findings</h3>\n \n <p>We found 82 RCTs and 289 systematic reviews/meta-analyses published in 2021. More than half (<i>n</i> = 46, 56%) of RCTs and almost all (n = 278, 96%) systematic reviews and meta-analyses were at high risk of bias. Only one (1%) RCT and four (1%) systematic reviews and meta-analyses were adequately reported. Less than half (<i>n</i> = 40, 49%) of RCTs and just over a quarter (<i>n</i> = 77, 27%) of systematic reviews and meta-analyses had a registered protocol. Surprisingly, we found that more than half of systematic reviews and meta-analyse (<i>n</i> = 162, 56.1%), had no risk of bias assessment.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>Recently published RCTs and systematic reviews in pediatric surgery are at high risk of bias and have poor reporting quality. Journals, universities, and research institutions should train authors to conduct and report higher quality studies and develop strategies to reduce risk of bias. However, research with high bias and low reporting does not necessarily lack value.</p>\n </section>\n </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12042","citationCount":"0","resultStr":"{\"title\":\"Quality of randomized controlled trials and systematic reviews in pediatric surgery: A cross-sectional meta-research study\",\"authors\":\"Wilson Jiang, Bill Wang, Sandro Sperandei, Aidan Christopher Tan\",\"doi\":\"10.1002/cesm.12042\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Background</h3>\\n \\n <p>There are few randomized controlled trials (RCTs) in pediatric surgery, and their risk of bias is unknown. There is also little known about the methodological or reporting quality of systematic reviews (with or without meta-analyses) in pediatric surgery. Therefore, we conducted a cross-sectional meta-research study to determine the risk of bias and reporting quality of RCTs and systematic reviews and meta-analyses in pediatric surgery, and the associations between these outcomes and study characteristics.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Methods</h3>\\n \\n <p>We searched MEDLINE, Embase, Cochrane Library, JBI EBP Database, Centre for Reviews and Dissemination and Web of Science for all RCTs and systematic reviews in pediatric surgery published in 2021. We also searched the 2021 indexes of high-impact pediatric surgery journals. We assessed the risk of bias and reporting quality of RCTs using the RoB 2 and CONSORT tools respectively. We assessed the same parameters for systematic reviews and meta-analyses using the ROBIS and Preferred Reporting Items for Systematic Reviews and Meta-analyses tools.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Findings</h3>\\n \\n <p>We found 82 RCTs and 289 systematic reviews/meta-analyses published in 2021. More than half (<i>n</i> = 46, 56%) of RCTs and almost all (n = 278, 96%) systematic reviews and meta-analyses were at high risk of bias. Only one (1%) RCT and four (1%) systematic reviews and meta-analyses were adequately reported. Less than half (<i>n</i> = 40, 49%) of RCTs and just over a quarter (<i>n</i> = 77, 27%) of systematic reviews and meta-analyses had a registered protocol. Surprisingly, we found that more than half of systematic reviews and meta-analyse (<i>n</i> = 162, 56.1%), had no risk of bias assessment.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusions</h3>\\n \\n <p>Recently published RCTs and systematic reviews in pediatric surgery are at high risk of bias and have poor reporting quality. Journals, universities, and research institutions should train authors to conduct and report higher quality studies and develop strategies to reduce risk of bias. However, research with high bias and low reporting does not necessarily lack value.</p>\\n </section>\\n </div>\",\"PeriodicalId\":100286,\"journal\":{\"name\":\"Cochrane Evidence Synthesis and Methods\",\"volume\":\"2 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12042\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cochrane Evidence Synthesis and Methods\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/cesm.12042\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cochrane Evidence Synthesis and Methods","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cesm.12042","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Quality of randomized controlled trials and systematic reviews in pediatric surgery: A cross-sectional meta-research study
Background
There are few randomized controlled trials (RCTs) in pediatric surgery, and their risk of bias is unknown. There is also little known about the methodological or reporting quality of systematic reviews (with or without meta-analyses) in pediatric surgery. Therefore, we conducted a cross-sectional meta-research study to determine the risk of bias and reporting quality of RCTs and systematic reviews and meta-analyses in pediatric surgery, and the associations between these outcomes and study characteristics.
Methods
We searched MEDLINE, Embase, Cochrane Library, JBI EBP Database, Centre for Reviews and Dissemination and Web of Science for all RCTs and systematic reviews in pediatric surgery published in 2021. We also searched the 2021 indexes of high-impact pediatric surgery journals. We assessed the risk of bias and reporting quality of RCTs using the RoB 2 and CONSORT tools respectively. We assessed the same parameters for systematic reviews and meta-analyses using the ROBIS and Preferred Reporting Items for Systematic Reviews and Meta-analyses tools.
Findings
We found 82 RCTs and 289 systematic reviews/meta-analyses published in 2021. More than half (n = 46, 56%) of RCTs and almost all (n = 278, 96%) systematic reviews and meta-analyses were at high risk of bias. Only one (1%) RCT and four (1%) systematic reviews and meta-analyses were adequately reported. Less than half (n = 40, 49%) of RCTs and just over a quarter (n = 77, 27%) of systematic reviews and meta-analyses had a registered protocol. Surprisingly, we found that more than half of systematic reviews and meta-analyse (n = 162, 56.1%), had no risk of bias assessment.
Conclusions
Recently published RCTs and systematic reviews in pediatric surgery are at high risk of bias and have poor reporting quality. Journals, universities, and research institutions should train authors to conduct and report higher quality studies and develop strategies to reduce risk of bias. However, research with high bias and low reporting does not necessarily lack value.