Current and future trends in marine image annotation software.

Gomes-Pereira, Jose Nuno, Auger, Vincent, Beisiegel, Kolja, Benjamin, Robert, Bergmann, Melanie, Bowden, David, Buhl-Mortensen, Pal, De Leo, Fabio C., Dionísio, Gisela, Durden, Jennifer M., Edwards, Luke, Friedman, Ariell, Greinert, Jens , Jacobsen-Stout, Nancy, Lerner, Steve, Leslie, Murray, Nattkemper, Tim W., Sameoto, Jessica A., Schoening, Timm , Schouten, Ronald, Seager, James, Singh, Hanumant, Soubigou, Olivier, Tojeira, Inês, van den Beld, Inge, Dias, Frederico, Tempera, Fernando and Santos, Ricardo S. (2016) Current and future trends in marine image annotation software. Progress in Oceanography, 149 . pp. 106-120. DOI 10.1016/j.pocean.2016.07.005.

[thumbnail of Gomes-Pereira.pdf] Text
Gomes-Pereira.pdf - Published Version
Restricted to Registered users only

Download (700kB) | Contact

Supplementary data:

Abstract

Highlights

• Marine Image Annotation Software (MIAS) are used to assist annotation of underwater imagery.
• We compare 23 MIAS assisting human annotation including some that include automated annotation.
• MIAS can run in real time (50%), allow posterior annotation (95%), and interact with databases and data flows (44%).
• MIAS differ in data input/output and display, customization, image analysis and re-annotation.
• We provide important considerations when selecting UIAS, and outline future trends.

Abstract

Given the need to describe, analyze and index large quantities of marine imagery data for exploration and monitoring activities, a range of specialized image annotation tools have been developed worldwide. Image annotation - the process of transposing objects or events represented in a video or still image to the semantic level, may involve human interactions and computer-assisted solutions. Marine image annotation software (MIAS) have enabled over 500 publications to date. We review the functioning, application trends and developments, by comparing general and advanced features of 23 different tools utilized in underwater image analysis. MIAS requiring human input are basically a graphical user interface, with a video player or image browser that recognizes a specific time code or image code, allowing to log events in a time-stamped (and/or geo-referenced) manner. MIAS differ from similar software by the capability of integrating data associated to video collection, the most simple being the position coordinates of the video recording platform. MIAS have three main characteristics: annotating events in real time, in posteriorly to annotation and interact with a database. These range from simple annotation interfaces, to full onboard data management systems, with a variety of toolboxes. Advanced packages allow to input and display of data from multiple sensors or multiple annotators via intranet or internet. Posterior human-mediated annotation often include tools for data display and image analysis, e.g. length, area, image segmentation, point count; and in a few cases the possibility of browsing and editing previous dive logs or to analyze annotation data. The interaction with a database allows the automatic integration of annotations from different surveys, repeated annotation and collaborative annotation of shared datasets, browsing and querying of data. Progress in the field of automated annotation is mostly in post processing, for stable platforms or still images. Integration into available MIAS is currently limited to semi-automated processes of pixel recognition through computer-vision modules that compile expert-based knowledge. Important topics aiding the choice of a specific software are outlined, the ideal software is discussed and future trends are presented.

Document Type: Article
Keywords: Underwater visual surveys; image analysis; image annotation; data collection; data storage; monitoring; marine imaging
Research affiliation: OceanRep > GEOMAR > FB2 Marine Biogeochemistry > FB2-MG Marine Geosystems > DeepSea Monitoring
Kiel University
OceanRep > GEOMAR > FB2 Marine Biogeochemistry > FB2-MG Marine Geosystems
HGF-AWI
Refereed: Yes
Open Access Journal?: No
Publisher: Elsevier
Projects: ROBEX
Contribution Number:
Project
Number
DSM
20
Date Deposited: 04 Oct 2016 07:00
Last Modified: 23 Sep 2019 22:55
URI: https://oceanrep.geomar.de/id/eprint/34089

Actions (login required)

View Item View Item