Alexander Popkov, Fedor Konstantinov, Vladimir Neimorovets, Alexey Solodovnikov
{"title":"基于专家级图像的高度多样化植物昆虫科Miridae非常相似物种识别的机器学习(半翅目:异翅目)","authors":"Alexander Popkov, Fedor Konstantinov, Vladimir Neimorovets, Alexey Solodovnikov","doi":"10.1111/syen.12543","DOIUrl":null,"url":null,"abstract":"<p>Deep learning algorithms and particularly convolutional neural networks are very successful in pattern recognition from images and are increasingly employed in biology. The development of automated systems for rapid and reliable species identification is vital for insect systematics and may revolutionize this field soon. In this study, we demonstrate the ability of a convolutional neural network to identify species based on habitus photographs with expert-level accuracy in a taxonomically challenging group where a human-based identification would require notorious genitalia dissections. Using the economically important and polymorphic plant bug genus <i>Adelphocoris Reuter</i> (Heteroptera: Miridae) as a model group, we explore the variability in the performance of 11 convolutional neural models most commonly used for image classification, test the role of class-imbalance on the model performance assessment and visualize areas of interest using three interpretation algorithms. Classification performance in our experiments with collection-based habitus photographs is high enough to identify very similar species from a large group with an expert-level accuracy. The accuracy is getting lower only in the experiments with an additional dataset of <i>Adelphocoris</i> and other live plant bugs photographs taken from the Web. Our article demonstrates the importance of comprehensive institutional insect collections for bringing deep learning algorithms into service for systematic entomology using affordable equipment and methods.</p>","PeriodicalId":22126,"journal":{"name":"Systematic Entomology","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2022-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Machine learning for expert-level image-based identification of very similar species in the hyperdiverse plant bug family Miridae (Hemiptera: Heteroptera)\",\"authors\":\"Alexander Popkov, Fedor Konstantinov, Vladimir Neimorovets, Alexey Solodovnikov\",\"doi\":\"10.1111/syen.12543\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Deep learning algorithms and particularly convolutional neural networks are very successful in pattern recognition from images and are increasingly employed in biology. The development of automated systems for rapid and reliable species identification is vital for insect systematics and may revolutionize this field soon. In this study, we demonstrate the ability of a convolutional neural network to identify species based on habitus photographs with expert-level accuracy in a taxonomically challenging group where a human-based identification would require notorious genitalia dissections. Using the economically important and polymorphic plant bug genus <i>Adelphocoris Reuter</i> (Heteroptera: Miridae) as a model group, we explore the variability in the performance of 11 convolutional neural models most commonly used for image classification, test the role of class-imbalance on the model performance assessment and visualize areas of interest using three interpretation algorithms. Classification performance in our experiments with collection-based habitus photographs is high enough to identify very similar species from a large group with an expert-level accuracy. The accuracy is getting lower only in the experiments with an additional dataset of <i>Adelphocoris</i> and other live plant bugs photographs taken from the Web. Our article demonstrates the importance of comprehensive institutional insect collections for bringing deep learning algorithms into service for systematic entomology using affordable equipment and methods.</p>\",\"PeriodicalId\":22126,\"journal\":{\"name\":\"Systematic Entomology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2022-03-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Systematic Entomology\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/syen.12543\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENTOMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Systematic Entomology","FirstCategoryId":"97","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/syen.12543","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENTOMOLOGY","Score":null,"Total":0}
Machine learning for expert-level image-based identification of very similar species in the hyperdiverse plant bug family Miridae (Hemiptera: Heteroptera)
Deep learning algorithms and particularly convolutional neural networks are very successful in pattern recognition from images and are increasingly employed in biology. The development of automated systems for rapid and reliable species identification is vital for insect systematics and may revolutionize this field soon. In this study, we demonstrate the ability of a convolutional neural network to identify species based on habitus photographs with expert-level accuracy in a taxonomically challenging group where a human-based identification would require notorious genitalia dissections. Using the economically important and polymorphic plant bug genus Adelphocoris Reuter (Heteroptera: Miridae) as a model group, we explore the variability in the performance of 11 convolutional neural models most commonly used for image classification, test the role of class-imbalance on the model performance assessment and visualize areas of interest using three interpretation algorithms. Classification performance in our experiments with collection-based habitus photographs is high enough to identify very similar species from a large group with an expert-level accuracy. The accuracy is getting lower only in the experiments with an additional dataset of Adelphocoris and other live plant bugs photographs taken from the Web. Our article demonstrates the importance of comprehensive institutional insect collections for bringing deep learning algorithms into service for systematic entomology using affordable equipment and methods.
期刊介绍:
Systematic Entomology publishes original papers on insect systematics, phylogenetics and integrative taxonomy, with a preference for general interest papers of broad biological, evolutionary or zoogeographical relevance.