A Deep Learning Approach for Locating Microalgae in Image Captured by Smartphone and Digital Microscope Camera

Q3 Engineering
Nitiphong Kaewman, Phasit Charoenkwan, Jinnapat Yana, Phon-ubon Suanoi, K. Duangjan, J. Pekkoh, Chayakorn Pumas
{"title":"A Deep Learning Approach for Locating Microalgae in Image Captured by Smartphone and Digital Microscope Camera","authors":"Nitiphong Kaewman, Phasit Charoenkwan, Jinnapat Yana, Phon-ubon Suanoi, K. Duangjan, J. Pekkoh, Chayakorn Pumas","doi":"10.1109/ECTIDAMTNCON57770.2023.10139572","DOIUrl":null,"url":null,"abstract":"The utilization of microalgae as a bioindicator for water quality assessment has traditionally relied on the expertise of morphological identification. With the advent of technological advancements, particularly the smartphone camera, there has been increasing interest in using it as a tool for various fields of microbiological and medical diagnostics, including image analysis of microalgae. Despite the growing popularity of smartphone-based image analysis, the image quality of smartphone cameras for detecting microalgae has yet to be thoroughly evaluated. Therefore, the purpose of this study was to investigate the suitability of smartphone-based camera for collecting microalgae images and compare it to that of a digital microscope camera. Additionally, the effect of different microscopic magnifications at 100x and 400x on model performance was thoroughly studied. Four models, YOLOv5, RetinaNet, EfficientDet, and Faster-RCNN, were trained on microalgae image datasets taken by both a smartphone camera (SC) and a digital microscope camera (DMC) under 100x and 400x magnification. A total of 11,608 images were divided into three parts: train (70%), validation (10%), and test (20%), with the test dataset separated into four parts for each device and magnification. The results of the study indicated that Faster-RCNN was the best model for microalgae detection, with the highest average precision $(\\mathbf{AP}^{0.5})$ values of 0.60, 0.84, 0.91, and 0.96 at 100x magnification of SC and DMC and 400x magnification of SC and DMC, respectively. The comparison between the image quality of SC and DMC at each magnification revealed that the SC was less suitable for microalgae identification, particularly at 100x magnification. Conversely, the 400x magnification of SC had the potential to identify microalgae through the use of smartphone-based photography, as well as digital microscope camera.","PeriodicalId":38808,"journal":{"name":"Transactions on Electrical Engineering, Electronics, and Communications","volume":"75 1","pages":"457-462"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions on Electrical Engineering, Electronics, and Communications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ECTIDAMTNCON57770.2023.10139572","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0

Abstract

The utilization of microalgae as a bioindicator for water quality assessment has traditionally relied on the expertise of morphological identification. With the advent of technological advancements, particularly the smartphone camera, there has been increasing interest in using it as a tool for various fields of microbiological and medical diagnostics, including image analysis of microalgae. Despite the growing popularity of smartphone-based image analysis, the image quality of smartphone cameras for detecting microalgae has yet to be thoroughly evaluated. Therefore, the purpose of this study was to investigate the suitability of smartphone-based camera for collecting microalgae images and compare it to that of a digital microscope camera. Additionally, the effect of different microscopic magnifications at 100x and 400x on model performance was thoroughly studied. Four models, YOLOv5, RetinaNet, EfficientDet, and Faster-RCNN, were trained on microalgae image datasets taken by both a smartphone camera (SC) and a digital microscope camera (DMC) under 100x and 400x magnification. A total of 11,608 images were divided into three parts: train (70%), validation (10%), and test (20%), with the test dataset separated into four parts for each device and magnification. The results of the study indicated that Faster-RCNN was the best model for microalgae detection, with the highest average precision $(\mathbf{AP}^{0.5})$ values of 0.60, 0.84, 0.91, and 0.96 at 100x magnification of SC and DMC and 400x magnification of SC and DMC, respectively. The comparison between the image quality of SC and DMC at each magnification revealed that the SC was less suitable for microalgae identification, particularly at 100x magnification. Conversely, the 400x magnification of SC had the potential to identify microalgae through the use of smartphone-based photography, as well as digital microscope camera.
智能手机和数码显微镜相机图像中微藻定位的深度学习方法
利用微藻作为水质评价的生物指标,传统上依赖于形态学鉴定的专业知识。随着技术的进步,特别是智能手机相机的出现,人们越来越有兴趣将其作为微生物和医学诊断各个领域的工具,包括微藻的图像分析。尽管基于智能手机的图像分析越来越受欢迎,但用于检测微藻的智能手机相机的图像质量尚未得到彻底的评估。因此,本研究的目的是探讨智能手机相机采集微藻图像的适用性,并将其与数码显微镜相机进行比较。此外,还深入研究了100倍和400倍不同放大率对模型性能的影响。利用智能手机相机(SC)和数码显微镜相机(DMC)在100倍和400倍放大率下拍摄的微藻图像数据集,对YOLOv5、RetinaNet、EfficientDet和Faster-RCNN四种模型进行了训练。将11,608张图像分为训练(70%)、验证(10%)和测试(20%)三个部分,其中测试数据集根据每个设备和放大倍数分为四部分。研究结果表明,fast - rcnn是微藻检测的最佳模型,在SC和DMC的100倍放大倍数和400倍放大倍数下,其平均精度$(\mathbf{AP}^{0.5})$分别为0.60、0.84、0.91和0.96。SC和DMC在各倍率下的图像质量比较表明,SC不太适合微藻鉴定,特别是在100倍倍率下。相反,SC的400倍放大率有可能通过使用基于智能手机的摄影以及数码显微镜相机来识别微藻。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Transactions on Electrical Engineering, Electronics, and Communications
Transactions on Electrical Engineering, Electronics, and Communications Engineering-Electrical and Electronic Engineering
CiteScore
1.60
自引率
0.00%
发文量
45
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信