Influence of camera type, height and image enhancement on photogrammetry success in turbid marine environments.

Kesia Louise Savill, Iain Parnum, Jennifer McIlwain, David Belton
{"title":"Influence of camera type, height and image enhancement on photogrammetry success in turbid marine environments.","authors":"Kesia Louise Savill, Iain Parnum, Jennifer McIlwain, David Belton","doi":"10.1101/2024.09.15.613158","DOIUrl":null,"url":null,"abstract":"Over the last decade, Structure-from-Motion (SfM) photogrammetry has successfully been used to survey marine benthic environments, including artificial reefs, shipwrecks, and coral reefs, for a wide range of applications. The method is likely to become one of the most common tools for surveying marine benthic environments. However, SfM photogrammetry has been developed in clear water environments, and its suitability in turbid, benthic environments is less certain. Turbid coral reefs are example of an important marine benthic environment, making up 12% of coral reefs globally. Corals in these environments have a tolerance for low-light and high sediment conditions. Such attributes mean these reefs may be important refuges from extreme light and temperatures. Therefore, assessment and optimisation of the photogrammetry methodology in these environments is needed. This study investigates the performance of SfM photogrammetry in turbid environments, by comparing two camera types, settings (automatic vs manual derived from local conditions), the height of image acquisition above the seafloor, and post-processing image enhancement. Three dimensional (3D) SfM photogrammetry meshes of an artificial reef structure using two cameras, an action camera and a compact camera, were compared with its known dimensions detailed in an engineering diagram. According to surface area calculations, the compact camera provided a better 3D mesh than the action camera, with surface area calculations providing an accuracy of 98.2% against the engineering model, compared to 93.2% for the action camera. Images taken at a height of 1 m above the seafloor provided 3D meshes that were more accurate than those using images taken at 2 m above the seafloor. Two image enhancement techniques, histogram equalisation and contrast limited adaptive histogram equalisation (CLAHE), were then applied to assess if this improved the SfM photogrammetry mesh. The 3D mesh from images using the action camera that had a histogram equalisation enhancement provided the most comparable surface area measurement to the engineering diagram, with 100.6% accuracy, indicating our mesh had accounted for growth of benthic organisms on the structure since its installation. In contrast, raw (not enhanced) images had most comparable surface area measurement (98.2% accuracy) using the compact camera. However, the higher apparent accuracy of surface area measurements with the action camera following image enhancement may also be an artefact of inaccurate visual representations from the 3D mesh. Given the comparable accuracy of both approaches, we suggest SfM photogrammetry in turbid benthic environments uses cameras with a larger sensor sizes and customisable settings. This will result in the most accurate 3D meshes from raw imagery, particularly with images taken at a close distance (e.g., ≤ 1 m above the seafloor) and at high intervals (0.5 sec) with percentage overlap (>70%) among images. As the artificial reef in this study was in shallow water (3-4m), lights and/or strobes should be taken into consideration in deeper turbid waters but can also cause problems such as backscatter. Lastly, image enhancement can provide a means to improve image quality, and overall 3D mesh accuracy, when raw image quality and choice of cameras settings were poor.","PeriodicalId":501320,"journal":{"name":"bioRxiv - Ecology","volume":"215 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"bioRxiv - Ecology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.09.15.613158","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Over the last decade, Structure-from-Motion (SfM) photogrammetry has successfully been used to survey marine benthic environments, including artificial reefs, shipwrecks, and coral reefs, for a wide range of applications. The method is likely to become one of the most common tools for surveying marine benthic environments. However, SfM photogrammetry has been developed in clear water environments, and its suitability in turbid, benthic environments is less certain. Turbid coral reefs are example of an important marine benthic environment, making up 12% of coral reefs globally. Corals in these environments have a tolerance for low-light and high sediment conditions. Such attributes mean these reefs may be important refuges from extreme light and temperatures. Therefore, assessment and optimisation of the photogrammetry methodology in these environments is needed. This study investigates the performance of SfM photogrammetry in turbid environments, by comparing two camera types, settings (automatic vs manual derived from local conditions), the height of image acquisition above the seafloor, and post-processing image enhancement. Three dimensional (3D) SfM photogrammetry meshes of an artificial reef structure using two cameras, an action camera and a compact camera, were compared with its known dimensions detailed in an engineering diagram. According to surface area calculations, the compact camera provided a better 3D mesh than the action camera, with surface area calculations providing an accuracy of 98.2% against the engineering model, compared to 93.2% for the action camera. Images taken at a height of 1 m above the seafloor provided 3D meshes that were more accurate than those using images taken at 2 m above the seafloor. Two image enhancement techniques, histogram equalisation and contrast limited adaptive histogram equalisation (CLAHE), were then applied to assess if this improved the SfM photogrammetry mesh. The 3D mesh from images using the action camera that had a histogram equalisation enhancement provided the most comparable surface area measurement to the engineering diagram, with 100.6% accuracy, indicating our mesh had accounted for growth of benthic organisms on the structure since its installation. In contrast, raw (not enhanced) images had most comparable surface area measurement (98.2% accuracy) using the compact camera. However, the higher apparent accuracy of surface area measurements with the action camera following image enhancement may also be an artefact of inaccurate visual representations from the 3D mesh. Given the comparable accuracy of both approaches, we suggest SfM photogrammetry in turbid benthic environments uses cameras with a larger sensor sizes and customisable settings. This will result in the most accurate 3D meshes from raw imagery, particularly with images taken at a close distance (e.g., ≤ 1 m above the seafloor) and at high intervals (0.5 sec) with percentage overlap (>70%) among images. As the artificial reef in this study was in shallow water (3-4m), lights and/or strobes should be taken into consideration in deeper turbid waters but can also cause problems such as backscatter. Lastly, image enhancement can provide a means to improve image quality, and overall 3D mesh accuracy, when raw image quality and choice of cameras settings were poor.
相机类型、高度和图像增强对在浑浊海洋环境中成功进行摄影测量的影响。
在过去的十年中,运动结构(SfM)摄影测量法已成功用于勘测海洋底栖环境,包括人工鱼礁、沉船和珊瑚礁,应用范围十分广泛。该方法很可能成为勘测海洋底栖环境的最常用工具之一。不过,SfM 摄影测量技术是在清水环境中开发的,其在浑浊的海底环境中的适用性还不太确定。浑浊的珊瑚礁是重要的海洋底栖环境,占全球珊瑚礁的 12%。这些环境中的珊瑚对弱光和高沉积物条件具有耐受性。这些特性意味着这些珊瑚礁可能是抵御极端光照和温度的重要避难所。因此,需要对这些环境中的摄影测量方法进行评估和优化。本研究通过比较两种相机类型、设置(根据当地条件自动与手动)、海底上方的图像采集高度以及后处理图像增强,研究了 SfM 摄影测量在浑浊环境中的性能。使用两台相机(行动相机和小型相机)对人工鱼礁结构进行三维(3D)SfM 摄影测量,并将其网格与工程图中的已知尺寸进行比较。根据表面积计算,紧凑型相机比行动相机提供了更好的三维网格,表面积计算与工程模型相比准确率为 98.2%,而行动相机为 93.2%。在距海底 1 米处拍摄的图像所提供的三维网格比在距海底 2 米处拍摄的图像更为精确。随后,应用了两种图像增强技术--直方图均衡化和对比度受限的自适应直方图均衡化(CLAHE),以评估这是否改善了 SfM 摄影测量网格。采用直方图均衡化增强技术的行动相机图像所生成的三维网格与工程图表所提供的表面积测量结果最具可比性,准确率达到 100.6%,这表明我们的网格考虑到了结构安装后底栖生物的生长情况。相比之下,使用小型相机测量原始图像(未增强)的表面积测量结果(准确率为 98.2%)最具可比性。不过,图像增强后的行动相机表面积测量精度更高,这也可能是三维网格视觉呈现不准确造成的。鉴于两种方法的精度相当,我们建议在浑浊底栖环境中进行 SfM 摄影测量时使用传感器尺寸更大、可定制设置的相机。这将从原始图像中获得最精确的三维网格,尤其是在近距离(如距离海底 ≤ 1 米)、高间隔(0.5 秒)和图像重叠率(70%)的情况下拍摄的图像。由于本研究中的人工鱼礁位于浅水区(3-4 米),因此在较深的浑浊水域中应考虑灯光和/或频闪,但也会造成反向散射等问题。最后,在原始图像质量和相机设置选择不佳的情况下,图像增强可以提供一种提高图像质量和整体三维网格精度的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信