Estimating body weight of caged sea cucumbers (Apostichopus japonicus) using an underwater time-lapse camera and image analysis by semantic segmentation
{"title":"Estimating body weight of caged sea cucumbers (Apostichopus japonicus) using an underwater time-lapse camera and image analysis by semantic segmentation","authors":"","doi":"10.1016/j.atech.2024.100520","DOIUrl":null,"url":null,"abstract":"<div><p>Image analysis is being developed to improve the efficiency of fishery and aquaculture technologies. Optical cameras are an easy and cost-effective method for monitoring fish and other species. In this study, a monitoring system that combines an underwater time-lapse camera and a deep learning-based image analysis was developed for utilization in integrated multi-trophic aquaculture (IMTA). The sea cucumber (<em>Apostichopus japonicus</em>) was used as a target species because the technology necessary for estimating growth, particularly in terms of weight, of caged sea cucumber using an underwater environment is still under study. Therefore, semantic segmentation was applied to classify the images into caged sea cucumbers and various underwater backgrounds. Multiple images of sea cucumbers were captured in a water tank that mimicked the box cage used in IMTA, and their body weights were measured simultaneously. For model development, approximately 1,300 images were prepared for the training and validation processes. The model then achieved an IoU (Intersection over Union) of approximately 94 % for the validation data. Next, the pixel numbers of sea cucumbers were converted into an area calculated using the size of the cage net as the background. The relationship between the area and weight of sea cucumbers yielded an approximate line for estimating body weight. As a result, the approximation line had a coefficient of determination of R<sup>2</sup> = 0.87 for training and validation data and RMSE (Root Mean Square Error) =1.81 and 6.78 g for sea cucumbers less than 10 and 110 g, respectively. Using the model, test images in an actual IMTA situation were applied, and the estimated body weights were close to the measured values for small sea cucumbers. If we apply this model to images obtained over an extended period, the growth of sea cucumbers in a time series can be understood.</p></div>","PeriodicalId":74813,"journal":{"name":"Smart agricultural technology","volume":null,"pages":null},"PeriodicalIF":6.3000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772375524001254/pdfft?md5=8353e5f87a58311b85b02fd77600a485&pid=1-s2.0-S2772375524001254-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Smart agricultural technology","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772375524001254","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
引用次数: 0
Abstract
Image analysis is being developed to improve the efficiency of fishery and aquaculture technologies. Optical cameras are an easy and cost-effective method for monitoring fish and other species. In this study, a monitoring system that combines an underwater time-lapse camera and a deep learning-based image analysis was developed for utilization in integrated multi-trophic aquaculture (IMTA). The sea cucumber (Apostichopus japonicus) was used as a target species because the technology necessary for estimating growth, particularly in terms of weight, of caged sea cucumber using an underwater environment is still under study. Therefore, semantic segmentation was applied to classify the images into caged sea cucumbers and various underwater backgrounds. Multiple images of sea cucumbers were captured in a water tank that mimicked the box cage used in IMTA, and their body weights were measured simultaneously. For model development, approximately 1,300 images were prepared for the training and validation processes. The model then achieved an IoU (Intersection over Union) of approximately 94 % for the validation data. Next, the pixel numbers of sea cucumbers were converted into an area calculated using the size of the cage net as the background. The relationship between the area and weight of sea cucumbers yielded an approximate line for estimating body weight. As a result, the approximation line had a coefficient of determination of R2 = 0.87 for training and validation data and RMSE (Root Mean Square Error) =1.81 and 6.78 g for sea cucumbers less than 10 and 110 g, respectively. Using the model, test images in an actual IMTA situation were applied, and the estimated body weights were close to the measured values for small sea cucumbers. If we apply this model to images obtained over an extended period, the growth of sea cucumbers in a time series can be understood.