Bahar Ünlü Gül, Oğuzhan Özcan, Serdar Doğan, Abdullah Arpaci
{"title":"凯末尔大学临床实验室生化检测结果自动验证系统的设计与验证。","authors":"Bahar Ünlü Gül, Oğuzhan Özcan, Serdar Doğan, Abdullah Arpaci","doi":"10.11613/BM.2022.030704","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Autoverification (AV) is a postanalytical tool that uses algorithms to validate test results according to specified criteria. The Clinical and Laboratory Standard Institute (CLSI) document for AV of clinical laboratory test result (AUTO-10A) includes recommendations for laboratories needing guidance on implementation of AV algorithms. The aim was to design and validate the AV algorithm for biochemical tests.</p><p><strong>Materials and methods: </strong>Criteria were defined according to AUTO-10A. Three different approaches for algorithm were used as result limit checks, which are reference range, reference range <b>±</b> total allowable error, and 2nd and 98th percentile values. To validate the algorithm, 720 cases in middleware were tested. For actual cases, 3,188,095 results and 194,520 reports in laboratory information system (LIS) were evaluated using the AV system. Cohen's kappa (κ) was calculated to determine the degree of agreement between seven independent reviewers and the AV system.</p><p><strong>Results: </strong>The AV passing rate was found between 77% and 85%. The highest rates of AV were in alanine transaminase (ALT), direct bilirubin (DBIL), and magnesium (Mg), which all had AV rates exceeding 85%. The most common reason for non-validated results was the result limit check (41%). A total of 328 reports evaluated by reviewers were compared to AV system. The statistical analysis resulted in a κ value between 0.39 and 0.63 (P < 0.001) and an agreement rate between 79% and 88%.</p><p><strong>Conclusions: </strong>Our improved model can help laboratories design, build, and validate AV systems and be used as starting point for different test groups.</p>","PeriodicalId":9021,"journal":{"name":"Biochemia Medica","volume":" ","pages":"030704"},"PeriodicalIF":3.8000,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9344865/pdf/","citationCount":"0","resultStr":"{\"title\":\"Designing and validating an autoverification system of biochemical test results in Hatay Mustafa Kemal University, clinical laboratory.\",\"authors\":\"Bahar Ünlü Gül, Oğuzhan Özcan, Serdar Doğan, Abdullah Arpaci\",\"doi\":\"10.11613/BM.2022.030704\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Autoverification (AV) is a postanalytical tool that uses algorithms to validate test results according to specified criteria. The Clinical and Laboratory Standard Institute (CLSI) document for AV of clinical laboratory test result (AUTO-10A) includes recommendations for laboratories needing guidance on implementation of AV algorithms. The aim was to design and validate the AV algorithm for biochemical tests.</p><p><strong>Materials and methods: </strong>Criteria were defined according to AUTO-10A. Three different approaches for algorithm were used as result limit checks, which are reference range, reference range <b>±</b> total allowable error, and 2nd and 98th percentile values. To validate the algorithm, 720 cases in middleware were tested. For actual cases, 3,188,095 results and 194,520 reports in laboratory information system (LIS) were evaluated using the AV system. Cohen's kappa (κ) was calculated to determine the degree of agreement between seven independent reviewers and the AV system.</p><p><strong>Results: </strong>The AV passing rate was found between 77% and 85%. The highest rates of AV were in alanine transaminase (ALT), direct bilirubin (DBIL), and magnesium (Mg), which all had AV rates exceeding 85%. The most common reason for non-validated results was the result limit check (41%). A total of 328 reports evaluated by reviewers were compared to AV system. The statistical analysis resulted in a κ value between 0.39 and 0.63 (P < 0.001) and an agreement rate between 79% and 88%.</p><p><strong>Conclusions: </strong>Our improved model can help laboratories design, build, and validate AV systems and be used as starting point for different test groups.</p>\",\"PeriodicalId\":9021,\"journal\":{\"name\":\"Biochemia Medica\",\"volume\":\" \",\"pages\":\"030704\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2022-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9344865/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biochemia Medica\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.11613/BM.2022.030704\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2022/8/5 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICAL LABORATORY TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biochemia Medica","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.11613/BM.2022.030704","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/8/5 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"MEDICAL LABORATORY TECHNOLOGY","Score":null,"Total":0}
Designing and validating an autoverification system of biochemical test results in Hatay Mustafa Kemal University, clinical laboratory.
Introduction: Autoverification (AV) is a postanalytical tool that uses algorithms to validate test results according to specified criteria. The Clinical and Laboratory Standard Institute (CLSI) document for AV of clinical laboratory test result (AUTO-10A) includes recommendations for laboratories needing guidance on implementation of AV algorithms. The aim was to design and validate the AV algorithm for biochemical tests.
Materials and methods: Criteria were defined according to AUTO-10A. Three different approaches for algorithm were used as result limit checks, which are reference range, reference range ± total allowable error, and 2nd and 98th percentile values. To validate the algorithm, 720 cases in middleware were tested. For actual cases, 3,188,095 results and 194,520 reports in laboratory information system (LIS) were evaluated using the AV system. Cohen's kappa (κ) was calculated to determine the degree of agreement between seven independent reviewers and the AV system.
Results: The AV passing rate was found between 77% and 85%. The highest rates of AV were in alanine transaminase (ALT), direct bilirubin (DBIL), and magnesium (Mg), which all had AV rates exceeding 85%. The most common reason for non-validated results was the result limit check (41%). A total of 328 reports evaluated by reviewers were compared to AV system. The statistical analysis resulted in a κ value between 0.39 and 0.63 (P < 0.001) and an agreement rate between 79% and 88%.
Conclusions: Our improved model can help laboratories design, build, and validate AV systems and be used as starting point for different test groups.
期刊介绍:
Biochemia Medica is the official peer-reviewed journal of the Croatian Society of Medical Biochemistry and Laboratory Medicine. Journal provides a wide coverage of research in all aspects of clinical chemistry and laboratory medicine. Following categories fit into the scope of the Journal: general clinical chemistry, haematology and haemostasis, molecular diagnostics and endocrinology. Development, validation and verification of analytical techniques and methods applicable to clinical chemistry and laboratory medicine are welcome as well as studies dealing with laboratory organization, automation and quality control. Journal publishes on a regular basis educative preanalytical case reports (Preanalytical mysteries), articles dealing with applied biostatistics (Lessons in biostatistics) and research integrity (Research integrity corner).