新生儿筛查质量保证的评分者间信度评估。

IF 3.8 3区 医学 Q1 MEDICAL LABORATORY TECHNOLOGY
Leonor Guiñón, Anna Soler, Rosa María López, Sonia Pajares, José Manuel González de Aledo, Ana Argudo-Ramírez, José Luis Marín, Judit García-Villoria, Ángeles Sahuquillo, Luisa Alvarez
{"title":"新生儿筛查质量保证的评分者间信度评估。","authors":"Leonor Guiñón,&nbsp;Anna Soler,&nbsp;Rosa María López,&nbsp;Sonia Pajares,&nbsp;José Manuel González de Aledo,&nbsp;Ana Argudo-Ramírez,&nbsp;José Luis Marín,&nbsp;Judit García-Villoria,&nbsp;Ángeles Sahuquillo,&nbsp;Luisa Alvarez","doi":"10.11613/BM.2022.030901","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>To ensure the quality of the new-born screening (NBS), our laboratory reviewed the analytical procedure to detect subjective steps that may represent a risk to the patient. Two subjective activities were identified in the extra-analytical phases: the classification of dried blood spots (DBS) according to their quality and the assignment of haemoglobin patterns. To keep these activities under control, inter-rater studies were implemented. This study aimed to evaluate the inter-rater reliability and the effectiveness of the measures taken to improve the agreement between observers, to assure NBS results' quality.</p><p><strong>Materials and methods: </strong>Dried blood spots specimens were used for the inter-rater studies. Ten studies were performed to assess DBS quality classification, and four to assess the assignment of haemoglobin patterns. Krippendorff's alpha test was used to estimate inter-rater reliability. Causes were investigated when alpha values were below 0.80.</p><p><strong>Results: </strong>For both activities, the reliability obtained in the first studies was inadequate. After investigation, we detected that the criterion to classify a DBS as scant was not consolidated, and also a lack of consensus on whether or not to report Bart's haemoglobin depending on its percentage. Alpha estimates became higher once the training was reinforced and a consensus about the appropriate criteria to be applied was reached.</p><p><strong>Conclusion: </strong>Inter-rater reliability assessment helped us to ensure the quality of subjective activities that could add variability to NBS results. Furthermore, the evolution of the alpha value over time allowed us to verify the effectiveness of the measures adopted.</p>","PeriodicalId":9021,"journal":{"name":"Biochemia Medica","volume":null,"pages":null},"PeriodicalIF":3.8000,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9344869/pdf/","citationCount":"2","resultStr":"{\"title\":\"Inter-rater reliability assessment for the new-born screening quality assurance.\",\"authors\":\"Leonor Guiñón,&nbsp;Anna Soler,&nbsp;Rosa María López,&nbsp;Sonia Pajares,&nbsp;José Manuel González de Aledo,&nbsp;Ana Argudo-Ramírez,&nbsp;José Luis Marín,&nbsp;Judit García-Villoria,&nbsp;Ángeles Sahuquillo,&nbsp;Luisa Alvarez\",\"doi\":\"10.11613/BM.2022.030901\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>To ensure the quality of the new-born screening (NBS), our laboratory reviewed the analytical procedure to detect subjective steps that may represent a risk to the patient. Two subjective activities were identified in the extra-analytical phases: the classification of dried blood spots (DBS) according to their quality and the assignment of haemoglobin patterns. To keep these activities under control, inter-rater studies were implemented. This study aimed to evaluate the inter-rater reliability and the effectiveness of the measures taken to improve the agreement between observers, to assure NBS results' quality.</p><p><strong>Materials and methods: </strong>Dried blood spots specimens were used for the inter-rater studies. Ten studies were performed to assess DBS quality classification, and four to assess the assignment of haemoglobin patterns. Krippendorff's alpha test was used to estimate inter-rater reliability. Causes were investigated when alpha values were below 0.80.</p><p><strong>Results: </strong>For both activities, the reliability obtained in the first studies was inadequate. After investigation, we detected that the criterion to classify a DBS as scant was not consolidated, and also a lack of consensus on whether or not to report Bart's haemoglobin depending on its percentage. Alpha estimates became higher once the training was reinforced and a consensus about the appropriate criteria to be applied was reached.</p><p><strong>Conclusion: </strong>Inter-rater reliability assessment helped us to ensure the quality of subjective activities that could add variability to NBS results. Furthermore, the evolution of the alpha value over time allowed us to verify the effectiveness of the measures adopted.</p>\",\"PeriodicalId\":9021,\"journal\":{\"name\":\"Biochemia Medica\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2022-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9344869/pdf/\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biochemia Medica\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.11613/BM.2022.030901\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICAL LABORATORY TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biochemia Medica","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.11613/BM.2022.030901","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICAL LABORATORY TECHNOLOGY","Score":null,"Total":0}
引用次数: 2

摘要

为了确保新生儿筛查(NBS)的质量,我们的实验室审查了分析程序,以检测可能对患者构成风险的主观步骤。在分析外阶段确定了两个主观活动:根据其质量对干血斑(DBS)进行分类和分配血红蛋白模式。为了控制这些活动,进行了评价者之间的研究。本研究旨在评估评估者之间的信度和所采取的措施的有效性,以提高观察者之间的一致性,以确保国家统计局结果的质量。材料与方法:采用干燥血斑标本进行鼠间研究。10项研究用于评估DBS质量分类,4项研究用于评估血红蛋白模式的分配。使用Krippendorff的alpha检验来估计评估者之间的信度。当alpha值低于0.80时,调查原因。结果:对于这两种活动,在第一次研究中获得的可靠性是不足的。经过调查,我们发现将DBS分类为缺乏的标准没有得到巩固,并且在是否根据其百分比报告Bart血红蛋白方面缺乏共识。一旦训练得到加强,并就适用的适当标准达成一致意见,阿尔法估计就会更高。结论:评分者间信度评估有助于我们确保主观活动的质量,从而增加NBS结果的可变性。此外,alpha值随时间的演变使我们能够验证所采用措施的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Inter-rater reliability assessment for the new-born screening quality assurance.

Introduction: To ensure the quality of the new-born screening (NBS), our laboratory reviewed the analytical procedure to detect subjective steps that may represent a risk to the patient. Two subjective activities were identified in the extra-analytical phases: the classification of dried blood spots (DBS) according to their quality and the assignment of haemoglobin patterns. To keep these activities under control, inter-rater studies were implemented. This study aimed to evaluate the inter-rater reliability and the effectiveness of the measures taken to improve the agreement between observers, to assure NBS results' quality.

Materials and methods: Dried blood spots specimens were used for the inter-rater studies. Ten studies were performed to assess DBS quality classification, and four to assess the assignment of haemoglobin patterns. Krippendorff's alpha test was used to estimate inter-rater reliability. Causes were investigated when alpha values were below 0.80.

Results: For both activities, the reliability obtained in the first studies was inadequate. After investigation, we detected that the criterion to classify a DBS as scant was not consolidated, and also a lack of consensus on whether or not to report Bart's haemoglobin depending on its percentage. Alpha estimates became higher once the training was reinforced and a consensus about the appropriate criteria to be applied was reached.

Conclusion: Inter-rater reliability assessment helped us to ensure the quality of subjective activities that could add variability to NBS results. Furthermore, the evolution of the alpha value over time allowed us to verify the effectiveness of the measures adopted.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Biochemia Medica
Biochemia Medica 医学-医学实验技术
CiteScore
5.50
自引率
3.00%
发文量
70
审稿时长
>12 weeks
期刊介绍: Biochemia Medica is the official peer-reviewed journal of the Croatian Society of Medical Biochemistry and Laboratory Medicine. Journal provides a wide coverage of research in all aspects of clinical chemistry and laboratory medicine. Following categories fit into the scope of the Journal: general clinical chemistry, haematology and haemostasis, molecular diagnostics and endocrinology. Development, validation and verification of analytical techniques and methods applicable to clinical chemistry and laboratory medicine are welcome as well as studies dealing with laboratory organization, automation and quality control. Journal publishes on a regular basis educative preanalytical case reports (Preanalytical mysteries), articles dealing with applied biostatistics (Lessons in biostatistics) and research integrity (Research integrity corner).
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信