Surveying the deep: A review of computer vision in the benthos

Abstract

The analysis of image data for benthic biodiversity monitoring is now commonplace within the domain of marine ecology. Whilst advances in imaging technologies have allowed for the collection of vast quantities of data, the curation of this has traditionally been performed manually, resulting in a bottleneck whereby data is collected faster than it can be processed. Recent years have seen marine ecologists turn to the domain of computer vision to help automate this curation process. However, as the knowledge required to build such systems spans both domains, there is a high barrier to entry. To help reduce this barrier, this paper aims to provide an introduction to computer vision-based benthic biodiversity monitoring via a comprehensive literature review. To aid ecologists, key computer vision concepts are described and example use-cases highlighted. The major challenges inherent to benthic imagery for computer vision systems are explored, alongside a discussion of how current systems attempt to mitigate against these. To aid computer scientists wishing to enter the domain, an exploration of currently available open-source benthic datasets is also provided. Recommendations for future research are explored, including a move towards human-centric techniques, committing to ablation studies, reaching community agreement on open-source benchmarking datasets, and an increased use of innovative methods to allow for improved answering of key benthic ecology questions.