Martina Lonati, Mohammad Jahanbakht, Danielle Atkins, Stacy L Bierwagen, Andrew Chin, Adam Barnett, Jodie L Rummer
{"title":"深度神经网络在表皮鲨鱼(Hemiscyllium ocellatum)各生命阶段照片识别中的新应用。","authors":"Martina Lonati, Mohammad Jahanbakht, Danielle Atkins, Stacy L Bierwagen, Andrew Chin, Adam Barnett, Jodie L Rummer","doi":"10.1111/jfb.15887","DOIUrl":null,"url":null,"abstract":"<p><p>Photographic identification (photo ID) is an established method that is used to count animals and track individuals' movements. This method performs well with some species of elasmobranchs (i.e., sharks, skates, and rays) where individuals have distinctive skin patterns. However, the unique skin patterns used for ID must be stable through time to allow re-identification of individuals in future sampling events. More recently, artificial intelligence (AI) models have substantially decreased the labor-intensive process of matching photos in extensive photo ID libraries and increased the reliability of photo ID. Here, photo ID and AI are used for the first time to identify epaulette sharks (Hemiscyllium ocellatum) at different life stages for approximately 2 years. An AI model was developed to assess and compare the reliability of human-classified ID patterns in juvenile and neonate sharks. The model also tested the persistence of unique patterns in adult sharks. Results indicate that immature life stages are unreliable for pattern identification, using both human and AI approaches, due to the plasticity of these subadult growth forms. Mature sharks maintain their patterns through time and can be identified by AI models with approximately 86% accuracy. The approach outlined in this study has the potential of validating the stability of ID patterns through time; however, testing on wild populations and long-term datasets is needed. This study's novel deep neural network development strategy offers a streamlined and accessible framework for generating a reliable model from a small data set, without requiring high-performance computing. Since many photo ID studies commence with limited datasets and resources, this AI model presents practical solutions to such constraints. Overall, this approach has the potential to address challenges associated with long-term photo ID data sets and the application of AI for shark identification.</p>","PeriodicalId":15794,"journal":{"name":"Journal of fish biology","volume":null,"pages":null},"PeriodicalIF":1.7000,"publicationDate":"2024-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Novel use of deep neural networks on photographic identification of epaulette sharks (Hemiscyllium ocellatum) across life stages.\",\"authors\":\"Martina Lonati, Mohammad Jahanbakht, Danielle Atkins, Stacy L Bierwagen, Andrew Chin, Adam Barnett, Jodie L Rummer\",\"doi\":\"10.1111/jfb.15887\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Photographic identification (photo ID) is an established method that is used to count animals and track individuals' movements. This method performs well with some species of elasmobranchs (i.e., sharks, skates, and rays) where individuals have distinctive skin patterns. However, the unique skin patterns used for ID must be stable through time to allow re-identification of individuals in future sampling events. More recently, artificial intelligence (AI) models have substantially decreased the labor-intensive process of matching photos in extensive photo ID libraries and increased the reliability of photo ID. Here, photo ID and AI are used for the first time to identify epaulette sharks (Hemiscyllium ocellatum) at different life stages for approximately 2 years. An AI model was developed to assess and compare the reliability of human-classified ID patterns in juvenile and neonate sharks. The model also tested the persistence of unique patterns in adult sharks. Results indicate that immature life stages are unreliable for pattern identification, using both human and AI approaches, due to the plasticity of these subadult growth forms. Mature sharks maintain their patterns through time and can be identified by AI models with approximately 86% accuracy. The approach outlined in this study has the potential of validating the stability of ID patterns through time; however, testing on wild populations and long-term datasets is needed. This study's novel deep neural network development strategy offers a streamlined and accessible framework for generating a reliable model from a small data set, without requiring high-performance computing. Since many photo ID studies commence with limited datasets and resources, this AI model presents practical solutions to such constraints. Overall, this approach has the potential to address challenges associated with long-term photo ID data sets and the application of AI for shark identification.</p>\",\"PeriodicalId\":15794,\"journal\":{\"name\":\"Journal of fish biology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2024-08-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of fish biology\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://doi.org/10.1111/jfb.15887\",\"RegionNum\":3,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"FISHERIES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of fish biology","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.1111/jfb.15887","RegionNum":3,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"FISHERIES","Score":null,"Total":0}
引用次数: 0
摘要
照片识别(photo ID)是一种成熟的方法,用于统计动物数量和追踪个体的活动。这种方法在某些种类的鳍鳃类动物(如鲨鱼、鳐鱼和魟)身上效果很好,因为这些动物的个体都有独特的皮肤纹路。但是,用于识别的独特皮肤模式必须在一段时间内保持稳定,以便在未来的采样活动中重新识别个体。最近,人工智能(AI)模型大大减少了在庞大的照片 ID 库中匹配照片这一劳动密集型过程,并提高了照片 ID 的可靠性。本文首次使用照片 ID 和人工智能来识别表皮鲨鱼(Hemiscyllium ocellatum)大约 2 年的不同生命阶段。我们开发了一个人工智能模型来评估和比较幼年鲨鱼和新生鲨鱼的人类分类 ID 模式的可靠性。该模型还测试了成年鲨鱼独特模式的持续性。结果表明,由于这些亚成体生长形式的可塑性,使用人类和人工智能方法对未成年生命阶段进行模式识别是不可靠的。成熟鲨鱼的模式会随着时间的推移而保持不变,人工智能模型识别的准确率约为 86%。本研究中概述的方法有可能验证识别模式随时间变化的稳定性;但是,还需要在野生种群和长期数据集上进行测试。本研究的新颖深度神经网络开发策略提供了一个简化、易用的框架,可从小型数据集生成可靠的模型,而无需高性能计算。由于许多照片 ID 研究都是在数据集和资源有限的情况下开始的,因此该人工智能模型为这些限制提供了切实可行的解决方案。总之,这种方法有可能解决与长期身份证照片数据集和人工智能在鲨鱼识别中的应用相关的挑战。
Novel use of deep neural networks on photographic identification of epaulette sharks (Hemiscyllium ocellatum) across life stages.
Photographic identification (photo ID) is an established method that is used to count animals and track individuals' movements. This method performs well with some species of elasmobranchs (i.e., sharks, skates, and rays) where individuals have distinctive skin patterns. However, the unique skin patterns used for ID must be stable through time to allow re-identification of individuals in future sampling events. More recently, artificial intelligence (AI) models have substantially decreased the labor-intensive process of matching photos in extensive photo ID libraries and increased the reliability of photo ID. Here, photo ID and AI are used for the first time to identify epaulette sharks (Hemiscyllium ocellatum) at different life stages for approximately 2 years. An AI model was developed to assess and compare the reliability of human-classified ID patterns in juvenile and neonate sharks. The model also tested the persistence of unique patterns in adult sharks. Results indicate that immature life stages are unreliable for pattern identification, using both human and AI approaches, due to the plasticity of these subadult growth forms. Mature sharks maintain their patterns through time and can be identified by AI models with approximately 86% accuracy. The approach outlined in this study has the potential of validating the stability of ID patterns through time; however, testing on wild populations and long-term datasets is needed. This study's novel deep neural network development strategy offers a streamlined and accessible framework for generating a reliable model from a small data set, without requiring high-performance computing. Since many photo ID studies commence with limited datasets and resources, this AI model presents practical solutions to such constraints. Overall, this approach has the potential to address challenges associated with long-term photo ID data sets and the application of AI for shark identification.
期刊介绍:
The Journal of Fish Biology is a leading international journal for scientists engaged in all aspects of fishes and fisheries research, both fresh water and marine. The journal publishes high-quality papers relevant to the central theme of fish biology and aims to bring together under one cover an overall picture of the research in progress and to provide international communication among researchers in many disciplines with a common interest in the biology of fish.