The reliability of character recognition: An Australian & New Zealand expert-novice comparison study in the interpretation of chemically recovered serial numbers
J.R. Waszczuk , J. Raymond , P. Maynard , C. Roux , S. Chadwick
{"title":"The reliability of character recognition: An Australian & New Zealand expert-novice comparison study in the interpretation of chemically recovered serial numbers","authors":"J.R. Waszczuk , J. Raymond , P. Maynard , C. Roux , S. Chadwick","doi":"10.1016/j.forsciint.2024.112127","DOIUrl":null,"url":null,"abstract":"<div><p>The chemical recovery of a defaced serial number is a common forensic science practice, however it is not understood how proficient experts perform in correctly identifying recovered serial numbers. Understanding the accuracy of experts and how they compare to novices in character recognition can help to establish a baseline for this expertise. In this study an expert-novice comparison assessment was completed involving 118 test plates, each stamped with six randomised alphanumeric characters. The plates were defaced and chemically recovered before being viewed by multiple participants over six time intervals. A total of 3169 character inspections were completed. An assessment of confidence and error rates were calculated for both expert (trained) and novice (untrained) participants. Errors were counted when a participant interpreted a different character to that of the ground truth and believed the result was accurate for reporting. The results showed a similar (2.3 % and 2.4 %) error rate for the cohorts, however a statistical difference in confidence levels was recorded, demonstrating the more conservative nature of experts. This study aims to assist in validating practitioner interpretations, through addressing some forensic science criticisms, such as establishing error rates to routine scientific practices.</p></div>","PeriodicalId":12341,"journal":{"name":"Forensic science international","volume":null,"pages":null},"PeriodicalIF":2.2000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Forensic science international","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0379073824002081","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, LEGAL","Score":null,"Total":0}
引用次数: 0
Abstract
The chemical recovery of a defaced serial number is a common forensic science practice, however it is not understood how proficient experts perform in correctly identifying recovered serial numbers. Understanding the accuracy of experts and how they compare to novices in character recognition can help to establish a baseline for this expertise. In this study an expert-novice comparison assessment was completed involving 118 test plates, each stamped with six randomised alphanumeric characters. The plates were defaced and chemically recovered before being viewed by multiple participants over six time intervals. A total of 3169 character inspections were completed. An assessment of confidence and error rates were calculated for both expert (trained) and novice (untrained) participants. Errors were counted when a participant interpreted a different character to that of the ground truth and believed the result was accurate for reporting. The results showed a similar (2.3 % and 2.4 %) error rate for the cohorts, however a statistical difference in confidence levels was recorded, demonstrating the more conservative nature of experts. This study aims to assist in validating practitioner interpretations, through addressing some forensic science criticisms, such as establishing error rates to routine scientific practices.
期刊介绍:
Forensic Science International is the flagship journal in the prestigious Forensic Science International family, publishing the most innovative, cutting-edge, and influential contributions across the forensic sciences. Fields include: forensic pathology and histochemistry, chemistry, biochemistry and toxicology, biology, serology, odontology, psychiatry, anthropology, digital forensics, the physical sciences, firearms, and document examination, as well as investigations of value to public health in its broadest sense, and the important marginal area where science and medicine interact with the law.
The journal publishes:
Case Reports
Commentaries
Letters to the Editor
Original Research Papers (Regular Papers)
Rapid Communications
Review Articles
Technical Notes.