MAIA—A machine learning assisted image annotation method for environmental monitoring and exploration.

Zurowietz, Martin, Langenkämper, Daniel, Hosking, Brett, Ruhl, Henry A., Nattkemper, Tim W. and Sarder, Pinaki (2018) MAIA—A machine learning assisted image annotation method for environmental monitoring and exploration. Open Access PLoS ONE, 13 (11). e0207498. DOI 10.1371/journal.pone.0207498.

[img]
Preview
Text
pone.0207498.pdf - Published Version
Available under License Creative Commons: Attribution 4.0.

Download (2319Kb) | Preview
[img] Archive
7354466.zip - Supplemental Material
Available under License Creative Commons: Attribution 4.0.

Download (4Mb)

Supplementary data:

Abstract

Digital imaging has become one of the most important techniques in environmental monitoring and exploration. In the case of the marine environment, mobile platforms such as autonomous underwater vehicles (AUVs) are now equipped with high-resolution cameras to capture huge collections of images from the seabed. However, the timely evaluation of all these images presents a bottleneck problem as tens of thousands or more images can be collected during a single dive. This makes computational support for marine image analysis essential. Computer-aided analysis of environmental images (and marine images in particular) with machine learning algorithms is promising, but challenging and different to other imaging domains because training data and class labels cannot be collected as efficiently and comprehensively as in other areas. In this paper, we present Machine learning Assisted Image Annotation (MAIA), a new image annotation method for environmental monitoring and exploration that overcomes the obstacle of missing training data. The method uses a combination of autoencoder networks and Mask Region-based Convolutional Neural Network (Mask R-CNN), which allows human observers to annotate large image collections much faster than before. We evaluated the method with three marine image datasets featuring different types of background, imaging equipment and object classes. Using MAIA, we were able to annotate objects of interest with an average recall of 84.1% more than twice as fast as compared to “traditional” annotation methods, which are purely based on software-supported direct visual inspection and manual annotation. The speed gain increases proportionally with the size of a dataset. The MAIA approach represents a substantial improvement on the path to greater efficiency in the annotation of large benthic image collections.

Document Type: Article
Keywords: MAIA, machine learning, image annotation method, environmental monitoring, exploration
Refereed: Yes
Open Access Journal?: Yes
DOI etc.: 10.1371/journal.pone.0207498
ISSN: 1932-6203
Projects: JPIO-MiningImpact
Expeditions/Models/Experiments:
Date Deposited: 06 Jan 2021 14:44
Last Modified: 20 Jan 2021 07:33
URI: http://oceanrep.geomar.de/id/eprint/51422

Actions (login required)

View Item View Item

Document Downloads

More statistics for this item...