David Makowski, Rui Catarino, Mathilde Chen, Simona Bosco, Ana Montero-Castaño, Marta Pérez-Soba, Andrea Schievano, Giovanni Tamburini
{"title":"综合meta分析的结果为政策提供信息:快速通道方法的比较","authors":"David Makowski, Rui Catarino, Mathilde Chen, Simona Bosco, Ana Montero-Castaño, Marta Pérez-Soba, Andrea Schievano, Giovanni Tamburini","doi":"10.1186/s13750-023-00309-y","DOIUrl":null,"url":null,"abstract":"<p><p>Statistical synthesis of data sets (meta-analysis, MA) has become a popular approach for providing scientific evidence to inform environmental and agricultural policy. As the number of published MAs is increasing exponentially, multiple MAs are now often available on a specific topic, delivering sometimes conflicting conclusions. To synthesise several MAs, a first approach is to extract the primary data of all the MAs and make a new MA of all data. However, this approach is not always compatible with the short period of time available to respond to a specific policy request. An alternative, and faster, approach is to synthesise the results of the MAs directly, without going back to the primary data. However, the reliability of this approach is not well known. In this paper, we evaluate three fast-track methods for synthesising the results of MAs without using the primary data. The performances of these methods are then compared to a global MA of primary data. Results show that two of the methods tested can yield similar conclusions when compared to global MA of primary data, especially when the level of redundancy between MAs is low. We show that the use of biased MAs can reduce the reliability of the conclusions derived from these methods.</p>","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2023-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11378786/pdf/","citationCount":"0","resultStr":"{\"title\":\"Synthesising results of meta-analyses to inform policy: a comparison of fast-track methods.\",\"authors\":\"David Makowski, Rui Catarino, Mathilde Chen, Simona Bosco, Ana Montero-Castaño, Marta Pérez-Soba, Andrea Schievano, Giovanni Tamburini\",\"doi\":\"10.1186/s13750-023-00309-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Statistical synthesis of data sets (meta-analysis, MA) has become a popular approach for providing scientific evidence to inform environmental and agricultural policy. As the number of published MAs is increasing exponentially, multiple MAs are now often available on a specific topic, delivering sometimes conflicting conclusions. To synthesise several MAs, a first approach is to extract the primary data of all the MAs and make a new MA of all data. However, this approach is not always compatible with the short period of time available to respond to a specific policy request. An alternative, and faster, approach is to synthesise the results of the MAs directly, without going back to the primary data. However, the reliability of this approach is not well known. In this paper, we evaluate three fast-track methods for synthesising the results of MAs without using the primary data. The performances of these methods are then compared to a global MA of primary data. Results show that two of the methods tested can yield similar conclusions when compared to global MA of primary data, especially when the level of redundancy between MAs is low. We show that the use of biased MAs can reduce the reliability of the conclusions derived from these methods.</p>\",\"PeriodicalId\":3,\"journal\":{\"name\":\"ACS Applied Electronic Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2023-08-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11378786/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Electronic Materials\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://doi.org/10.1186/s13750-023-00309-y\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1186/s13750-023-00309-y","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
摘要
数据集的统计综合(荟萃分析,MA)已成为为环境和农业政策提供科学依据的常用方法。由于已发表的荟萃分析呈指数级增长,现在往往有多个关于特定主题的荟萃分析,有时会得出相互矛盾的结论。要综合多篇千年生态系统评估,第一种方法是提取所有千年生态系统评估的主要数据,并将所有数据制成新的千年生态系统评估。然而,这种方法并不总能在短时间内满足特定的政策要求。另一种更快捷的方法是直接综合千年生态系统评估的结果,而无需返回原始数据。然而,这种方法的可靠性并不为人所知。在本文中,我们评估了三种不使用原始数据合成 MA 结果的快速方法。然后将这些方法的性能与原始数据的全局 MA 进行比较。结果表明,与原始数据的全局 MA 相比,所测试的两种方法可以得出相似的结论,尤其是当 MA 之间的冗余度较低时。我们表明,使用有偏差的 MA 会降低这些方法得出的结论的可靠性。
Synthesising results of meta-analyses to inform policy: a comparison of fast-track methods.
Statistical synthesis of data sets (meta-analysis, MA) has become a popular approach for providing scientific evidence to inform environmental and agricultural policy. As the number of published MAs is increasing exponentially, multiple MAs are now often available on a specific topic, delivering sometimes conflicting conclusions. To synthesise several MAs, a first approach is to extract the primary data of all the MAs and make a new MA of all data. However, this approach is not always compatible with the short period of time available to respond to a specific policy request. An alternative, and faster, approach is to synthesise the results of the MAs directly, without going back to the primary data. However, the reliability of this approach is not well known. In this paper, we evaluate three fast-track methods for synthesising the results of MAs without using the primary data. The performances of these methods are then compared to a global MA of primary data. Results show that two of the methods tested can yield similar conclusions when compared to global MA of primary data, especially when the level of redundancy between MAs is low. We show that the use of biased MAs can reduce the reliability of the conclusions derived from these methods.