Bruna Drielen Ferreira, Igor Renato Bertoni Olivares, Emanuel Carrilho, Vitor Hugo Polisél Pacces
{"title":"分析化学都是错的吗?再现性研究","authors":"Bruna Drielen Ferreira, Igor Renato Bertoni Olivares, Emanuel Carrilho, Vitor Hugo Polisél Pacces","doi":"10.1007/s00769-025-01649-7","DOIUrl":null,"url":null,"abstract":"<div><p>Reproducibility in science, particularly in fields that develop and apply analytical methods, such as analytical chemistry and related disciplines, has been increasingly questioned. A survey by Monya Baker (2016) indicated that most researchers acknowledge a reproducibility crisis. Frequently cited causes include low statistical power or poor analysis, insufficient replication in the original laboratory, unavailability of methods, poor experimental design, and absence of raw data. Chemistry was the field in which researchers most frequently reported difficulty reproducing both their own and others’ experiments. This study was conducted to confirm the existence of this crisis in analytical methods, quantify its extent, and evaluate its relationship with method validation and measurement uncertainty, which are based on statistical approaches and metrological principles, using the Analytical Quality Assurance Cycle. The results suggest that the crisis is directly associated with incorrect statistical procedures, inadequate validation criteria, and deficient execution of performance characteristics, factors that directly contribute to elevated measurement uncertainty. In 28% of the evaluated methods, expanded uncertainties exceeded 100% at the first point of the linearity assessment, compromising both result reliability and metrological traceability. These observations support concerns from previous studies regarding statistical errors, insufficient replication, and limited methodological transparency. Enhancing statistical training and quality assurance in academic programs, broader adoption of open science practices, and clearer policies aligned with international guidelines, such as EURACHEM, ISO/IEC 17025, and the OECD Principles of Good Laboratory Practice, may improve the reproducibility and reliability of analytical research.</p></div>","PeriodicalId":454,"journal":{"name":"Accreditation and Quality Assurance","volume":"30 4","pages":"361 - 366"},"PeriodicalIF":1.0000,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Is everything wrong in analytical chemistry? A study on reproducibility\",\"authors\":\"Bruna Drielen Ferreira, Igor Renato Bertoni Olivares, Emanuel Carrilho, Vitor Hugo Polisél Pacces\",\"doi\":\"10.1007/s00769-025-01649-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Reproducibility in science, particularly in fields that develop and apply analytical methods, such as analytical chemistry and related disciplines, has been increasingly questioned. A survey by Monya Baker (2016) indicated that most researchers acknowledge a reproducibility crisis. Frequently cited causes include low statistical power or poor analysis, insufficient replication in the original laboratory, unavailability of methods, poor experimental design, and absence of raw data. Chemistry was the field in which researchers most frequently reported difficulty reproducing both their own and others’ experiments. This study was conducted to confirm the existence of this crisis in analytical methods, quantify its extent, and evaluate its relationship with method validation and measurement uncertainty, which are based on statistical approaches and metrological principles, using the Analytical Quality Assurance Cycle. The results suggest that the crisis is directly associated with incorrect statistical procedures, inadequate validation criteria, and deficient execution of performance characteristics, factors that directly contribute to elevated measurement uncertainty. In 28% of the evaluated methods, expanded uncertainties exceeded 100% at the first point of the linearity assessment, compromising both result reliability and metrological traceability. These observations support concerns from previous studies regarding statistical errors, insufficient replication, and limited methodological transparency. Enhancing statistical training and quality assurance in academic programs, broader adoption of open science practices, and clearer policies aligned with international guidelines, such as EURACHEM, ISO/IEC 17025, and the OECD Principles of Good Laboratory Practice, may improve the reproducibility and reliability of analytical research.</p></div>\",\"PeriodicalId\":454,\"journal\":{\"name\":\"Accreditation and Quality Assurance\",\"volume\":\"30 4\",\"pages\":\"361 - 366\"},\"PeriodicalIF\":1.0000,\"publicationDate\":\"2025-06-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Accreditation and Quality Assurance\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s00769-025-01649-7\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"CHEMISTRY, ANALYTICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accreditation and Quality Assurance","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s00769-025-01649-7","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"CHEMISTRY, ANALYTICAL","Score":null,"Total":0}
Is everything wrong in analytical chemistry? A study on reproducibility
Reproducibility in science, particularly in fields that develop and apply analytical methods, such as analytical chemistry and related disciplines, has been increasingly questioned. A survey by Monya Baker (2016) indicated that most researchers acknowledge a reproducibility crisis. Frequently cited causes include low statistical power or poor analysis, insufficient replication in the original laboratory, unavailability of methods, poor experimental design, and absence of raw data. Chemistry was the field in which researchers most frequently reported difficulty reproducing both their own and others’ experiments. This study was conducted to confirm the existence of this crisis in analytical methods, quantify its extent, and evaluate its relationship with method validation and measurement uncertainty, which are based on statistical approaches and metrological principles, using the Analytical Quality Assurance Cycle. The results suggest that the crisis is directly associated with incorrect statistical procedures, inadequate validation criteria, and deficient execution of performance characteristics, factors that directly contribute to elevated measurement uncertainty. In 28% of the evaluated methods, expanded uncertainties exceeded 100% at the first point of the linearity assessment, compromising both result reliability and metrological traceability. These observations support concerns from previous studies regarding statistical errors, insufficient replication, and limited methodological transparency. Enhancing statistical training and quality assurance in academic programs, broader adoption of open science practices, and clearer policies aligned with international guidelines, such as EURACHEM, ISO/IEC 17025, and the OECD Principles of Good Laboratory Practice, may improve the reproducibility and reliability of analytical research.
期刊介绍:
Accreditation and Quality Assurance has established itself as the leading information and discussion forum for all aspects relevant to quality, transparency and reliability of measurement results in chemical and biological sciences. The journal serves the information needs of researchers, practitioners and decision makers dealing with quality assurance and quality management, including the development and application of metrological principles and concepts such as traceability or measurement uncertainty in the following fields: environment, nutrition, consumer protection, geology, metallurgy, pharmacy, forensics, clinical chemistry and laboratory medicine, and microbiology.