Shoutao Ni , Fangmao Ju , Jiaxin Zhang , Miaogen Xuan , Liang Chen , Shutao Zhang , Wenzhi Guo , Chunfeng Lian , Yang Li
{"title":"使用迁移学习和预先训练的深度神经网络进行尖锐损伤识别的可解释人工智能","authors":"Shoutao Ni , Fangmao Ju , Jiaxin Zhang , Miaogen Xuan , Liang Chen , Shutao Zhang , Wenzhi Guo , Chunfeng Lian , Yang Li","doi":"10.1016/j.forsciint.2025.112476","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>To investigate an AI-based method for automatically identifying and classifying sharp injuries using deep learning models, evaluate its effectiveness (e.g., accuracy and explainability), and support forensic injury classification.</div></div><div><h3>Methods</h3><div>A dataset comprising 1161 photos was collected, including stab wounds (723), chop wounds (314), and slash wounds (124) from homicide cases. After preprocessing and weighted random sampling, the processed dataset was divided into training and validation sets in an 8:2 ratio. Additionally, 212 images from new cases representing the three types of wounds were collected as an external dataset for a human vs. AI test. Specifically, three classification networks pre-trained on natural images—ResNet50, GoogLeNet, and ShuffleNet-V2—were fine-tuned via transfer learning on the training set. The models were then quantitatively tested in terms of precision, recall, F1 score, and reading time. The test results of AI models were compared with forensic pathologists using the external test data. Moreover, we analyzed the image explanation factors captured by these models according to the saliency maps produced by the class activation mapping techniques.</div></div><div><h3>Results</h3><div>All three models successfully classified three types of wounds. Among these, the GoogLeNet network model demonstrated an overall classification accuracy (total) and recall rate of 88.2 %. The model achieved its highest classification accuracy of 98.4 % for stab wounds, followed by 96.7 % for chop wounds and 30.0 % for slash wounds, the lowest among them. Classification accuracy is positively correlated with sample size. The model achieved a maximum precision rate of 88.4 % and a F1 score of 0.860, with a classification time of 0.04 seconds per image. A comparison with forensic pathologists revealed that the model's classification time was shorter, while its accuracy of stab and chop wounds was comparable to that of senior forensic pathologists, but the accuracy for slash wound was lower than that of junior forensic pathologists. The image explanation factors captured by AI models align closely with the characteristic wound positions identified by forensic pathologists.</div></div><div><h3>Conclusion</h3><div>The AI model effectively identifies the image characteristics of stab and chop wounds, enabling accurate recognition and rapid differentiation. The AI classification performance for stab and chop was comparable to that of senior forensic pathologists, implying the model’s practical utility.</div></div>","PeriodicalId":12341,"journal":{"name":"Forensic science international","volume":"371 ","pages":"Article 112476"},"PeriodicalIF":2.2000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Explainable AI for sharp injury identification using transfer learning with pre-trained deep neural networks\",\"authors\":\"Shoutao Ni , Fangmao Ju , Jiaxin Zhang , Miaogen Xuan , Liang Chen , Shutao Zhang , Wenzhi Guo , Chunfeng Lian , Yang Li\",\"doi\":\"10.1016/j.forsciint.2025.112476\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objective</h3><div>To investigate an AI-based method for automatically identifying and classifying sharp injuries using deep learning models, evaluate its effectiveness (e.g., accuracy and explainability), and support forensic injury classification.</div></div><div><h3>Methods</h3><div>A dataset comprising 1161 photos was collected, including stab wounds (723), chop wounds (314), and slash wounds (124) from homicide cases. After preprocessing and weighted random sampling, the processed dataset was divided into training and validation sets in an 8:2 ratio. Additionally, 212 images from new cases representing the three types of wounds were collected as an external dataset for a human vs. AI test. Specifically, three classification networks pre-trained on natural images—ResNet50, GoogLeNet, and ShuffleNet-V2—were fine-tuned via transfer learning on the training set. The models were then quantitatively tested in terms of precision, recall, F1 score, and reading time. The test results of AI models were compared with forensic pathologists using the external test data. Moreover, we analyzed the image explanation factors captured by these models according to the saliency maps produced by the class activation mapping techniques.</div></div><div><h3>Results</h3><div>All three models successfully classified three types of wounds. Among these, the GoogLeNet network model demonstrated an overall classification accuracy (total) and recall rate of 88.2 %. The model achieved its highest classification accuracy of 98.4 % for stab wounds, followed by 96.7 % for chop wounds and 30.0 % for slash wounds, the lowest among them. Classification accuracy is positively correlated with sample size. The model achieved a maximum precision rate of 88.4 % and a F1 score of 0.860, with a classification time of 0.04 seconds per image. A comparison with forensic pathologists revealed that the model's classification time was shorter, while its accuracy of stab and chop wounds was comparable to that of senior forensic pathologists, but the accuracy for slash wound was lower than that of junior forensic pathologists. The image explanation factors captured by AI models align closely with the characteristic wound positions identified by forensic pathologists.</div></div><div><h3>Conclusion</h3><div>The AI model effectively identifies the image characteristics of stab and chop wounds, enabling accurate recognition and rapid differentiation. The AI classification performance for stab and chop was comparable to that of senior forensic pathologists, implying the model’s practical utility.</div></div>\",\"PeriodicalId\":12341,\"journal\":{\"name\":\"Forensic science international\",\"volume\":\"371 \",\"pages\":\"Article 112476\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2025-04-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Forensic science international\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0379073825001148\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, LEGAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Forensic science international","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0379073825001148","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, LEGAL","Score":null,"Total":0}
Explainable AI for sharp injury identification using transfer learning with pre-trained deep neural networks
Objective
To investigate an AI-based method for automatically identifying and classifying sharp injuries using deep learning models, evaluate its effectiveness (e.g., accuracy and explainability), and support forensic injury classification.
Methods
A dataset comprising 1161 photos was collected, including stab wounds (723), chop wounds (314), and slash wounds (124) from homicide cases. After preprocessing and weighted random sampling, the processed dataset was divided into training and validation sets in an 8:2 ratio. Additionally, 212 images from new cases representing the three types of wounds were collected as an external dataset for a human vs. AI test. Specifically, three classification networks pre-trained on natural images—ResNet50, GoogLeNet, and ShuffleNet-V2—were fine-tuned via transfer learning on the training set. The models were then quantitatively tested in terms of precision, recall, F1 score, and reading time. The test results of AI models were compared with forensic pathologists using the external test data. Moreover, we analyzed the image explanation factors captured by these models according to the saliency maps produced by the class activation mapping techniques.
Results
All three models successfully classified three types of wounds. Among these, the GoogLeNet network model demonstrated an overall classification accuracy (total) and recall rate of 88.2 %. The model achieved its highest classification accuracy of 98.4 % for stab wounds, followed by 96.7 % for chop wounds and 30.0 % for slash wounds, the lowest among them. Classification accuracy is positively correlated with sample size. The model achieved a maximum precision rate of 88.4 % and a F1 score of 0.860, with a classification time of 0.04 seconds per image. A comparison with forensic pathologists revealed that the model's classification time was shorter, while its accuracy of stab and chop wounds was comparable to that of senior forensic pathologists, but the accuracy for slash wound was lower than that of junior forensic pathologists. The image explanation factors captured by AI models align closely with the characteristic wound positions identified by forensic pathologists.
Conclusion
The AI model effectively identifies the image characteristics of stab and chop wounds, enabling accurate recognition and rapid differentiation. The AI classification performance for stab and chop was comparable to that of senior forensic pathologists, implying the model’s practical utility.
期刊介绍:
Forensic Science International is the flagship journal in the prestigious Forensic Science International family, publishing the most innovative, cutting-edge, and influential contributions across the forensic sciences. Fields include: forensic pathology and histochemistry, chemistry, biochemistry and toxicology, biology, serology, odontology, psychiatry, anthropology, digital forensics, the physical sciences, firearms, and document examination, as well as investigations of value to public health in its broadest sense, and the important marginal area where science and medicine interact with the law.
The journal publishes:
Case Reports
Commentaries
Letters to the Editor
Original Research Papers (Regular Papers)
Rapid Communications
Review Articles
Technical Notes.