分析化学都是错的吗?再现性研究

IF 1 4区 工程技术 Q4 CHEMISTRY, ANALYTICAL
Bruna Drielen Ferreira, Igor Renato Bertoni Olivares, Emanuel Carrilho, Vitor Hugo Polisél Pacces
{"title":"分析化学都是错的吗?再现性研究","authors":"Bruna Drielen Ferreira,&nbsp;Igor Renato Bertoni Olivares,&nbsp;Emanuel Carrilho,&nbsp;Vitor Hugo Polisél Pacces","doi":"10.1007/s00769-025-01649-7","DOIUrl":null,"url":null,"abstract":"<div><p>Reproducibility in science, particularly in fields that develop and apply analytical methods, such as analytical chemistry and related disciplines, has been increasingly questioned. A survey by Monya Baker (2016) indicated that most researchers acknowledge a reproducibility crisis. Frequently cited causes include low statistical power or poor analysis, insufficient replication in the original laboratory, unavailability of methods, poor experimental design, and absence of raw data. Chemistry was the field in which researchers most frequently reported difficulty reproducing both their own and others’ experiments. This study was conducted to confirm the existence of this crisis in analytical methods, quantify its extent, and evaluate its relationship with method validation and measurement uncertainty, which are based on statistical approaches and metrological principles, using the Analytical Quality Assurance Cycle. The results suggest that the crisis is directly associated with incorrect statistical procedures, inadequate validation criteria, and deficient execution of performance characteristics, factors that directly contribute to elevated measurement uncertainty. In 28% of the evaluated methods, expanded uncertainties exceeded 100% at the first point of the linearity assessment, compromising both result reliability and metrological traceability. These observations support concerns from previous studies regarding statistical errors, insufficient replication, and limited methodological transparency. Enhancing statistical training and quality assurance in academic programs, broader adoption of open science practices, and clearer policies aligned with international guidelines, such as EURACHEM, ISO/IEC 17025, and the OECD Principles of Good Laboratory Practice, may improve the reproducibility and reliability of analytical research.</p></div>","PeriodicalId":454,"journal":{"name":"Accreditation and Quality Assurance","volume":"30 4","pages":"361 - 366"},"PeriodicalIF":1.0000,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Is everything wrong in analytical chemistry? A study on reproducibility\",\"authors\":\"Bruna Drielen Ferreira,&nbsp;Igor Renato Bertoni Olivares,&nbsp;Emanuel Carrilho,&nbsp;Vitor Hugo Polisél Pacces\",\"doi\":\"10.1007/s00769-025-01649-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Reproducibility in science, particularly in fields that develop and apply analytical methods, such as analytical chemistry and related disciplines, has been increasingly questioned. A survey by Monya Baker (2016) indicated that most researchers acknowledge a reproducibility crisis. Frequently cited causes include low statistical power or poor analysis, insufficient replication in the original laboratory, unavailability of methods, poor experimental design, and absence of raw data. Chemistry was the field in which researchers most frequently reported difficulty reproducing both their own and others’ experiments. This study was conducted to confirm the existence of this crisis in analytical methods, quantify its extent, and evaluate its relationship with method validation and measurement uncertainty, which are based on statistical approaches and metrological principles, using the Analytical Quality Assurance Cycle. The results suggest that the crisis is directly associated with incorrect statistical procedures, inadequate validation criteria, and deficient execution of performance characteristics, factors that directly contribute to elevated measurement uncertainty. In 28% of the evaluated methods, expanded uncertainties exceeded 100% at the first point of the linearity assessment, compromising both result reliability and metrological traceability. These observations support concerns from previous studies regarding statistical errors, insufficient replication, and limited methodological transparency. Enhancing statistical training and quality assurance in academic programs, broader adoption of open science practices, and clearer policies aligned with international guidelines, such as EURACHEM, ISO/IEC 17025, and the OECD Principles of Good Laboratory Practice, may improve the reproducibility and reliability of analytical research.</p></div>\",\"PeriodicalId\":454,\"journal\":{\"name\":\"Accreditation and Quality Assurance\",\"volume\":\"30 4\",\"pages\":\"361 - 366\"},\"PeriodicalIF\":1.0000,\"publicationDate\":\"2025-06-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Accreditation and Quality Assurance\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s00769-025-01649-7\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"CHEMISTRY, ANALYTICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accreditation and Quality Assurance","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s00769-025-01649-7","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"CHEMISTRY, ANALYTICAL","Score":null,"Total":0}
引用次数: 0

摘要

科学的可重复性,特别是在开发和应用分析方法的领域,如分析化学和相关学科,越来越受到质疑。Monya Baker(2016)的一项调查表明,大多数研究人员都承认存在可重复性危机。经常被引用的原因包括统计能力低或分析能力差,在原始实验室中复制不足,方法不可用,实验设计差,以及缺乏原始数据。化学是研究人员最常报告难以重现自己和他人实验的领域。本研究旨在确认分析方法中存在这种危机,量化其程度,并评估其与方法验证和测量不确定度的关系,这是基于统计方法和计量原理,使用分析质量保证周期。结果表明,危机与不正确的统计程序、不充分的验证标准和对性能特征的执行不足直接相关,这些因素直接导致测量不确定性升高。在28%的评估方法中,扩展不确定度在线性评估的第一点超过100%,损害了结果的可靠性和计量可追溯性。这些观察结果支持了先前研究中关于统计误差、复制不足和方法透明度有限的担忧。加强学术项目的统计培训和质量保证,更广泛地采用开放科学实践,制定更明确的政策,与国际准则(如EURACHEM、ISO/IEC 17025和经合组织良好实验室规范原则)保持一致,可以提高分析研究的可重复性和可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Is everything wrong in analytical chemistry? A study on reproducibility

Reproducibility in science, particularly in fields that develop and apply analytical methods, such as analytical chemistry and related disciplines, has been increasingly questioned. A survey by Monya Baker (2016) indicated that most researchers acknowledge a reproducibility crisis. Frequently cited causes include low statistical power or poor analysis, insufficient replication in the original laboratory, unavailability of methods, poor experimental design, and absence of raw data. Chemistry was the field in which researchers most frequently reported difficulty reproducing both their own and others’ experiments. This study was conducted to confirm the existence of this crisis in analytical methods, quantify its extent, and evaluate its relationship with method validation and measurement uncertainty, which are based on statistical approaches and metrological principles, using the Analytical Quality Assurance Cycle. The results suggest that the crisis is directly associated with incorrect statistical procedures, inadequate validation criteria, and deficient execution of performance characteristics, factors that directly contribute to elevated measurement uncertainty. In 28% of the evaluated methods, expanded uncertainties exceeded 100% at the first point of the linearity assessment, compromising both result reliability and metrological traceability. These observations support concerns from previous studies regarding statistical errors, insufficient replication, and limited methodological transparency. Enhancing statistical training and quality assurance in academic programs, broader adoption of open science practices, and clearer policies aligned with international guidelines, such as EURACHEM, ISO/IEC 17025, and the OECD Principles of Good Laboratory Practice, may improve the reproducibility and reliability of analytical research.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Accreditation and Quality Assurance
Accreditation and Quality Assurance 工程技术-分析化学
CiteScore
1.80
自引率
22.20%
发文量
39
审稿时长
6-12 weeks
期刊介绍: Accreditation and Quality Assurance has established itself as the leading information and discussion forum for all aspects relevant to quality, transparency and reliability of measurement results in chemical and biological sciences. The journal serves the information needs of researchers, practitioners and decision makers dealing with quality assurance and quality management, including the development and application of metrological principles and concepts such as traceability or measurement uncertainty in the following fields: environment, nutrition, consumer protection, geology, metallurgy, pharmacy, forensics, clinical chemistry and laboratory medicine, and microbiology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信