loading page

Vision-based Real-time Zooplankton Detection and Classification using Faster R-CNN
  • +1
  • Sadaf Ansari,
  • Aya Saad,
  • Annette Stahl,
  • Madhan Rajachandran
Sadaf Ansari
CSIR National Institute of Oceanography, Goa, India
Author Profile
Aya Saad
Norwegian University of Science and Technology

Corresponding Author:aya.saad@ntnu.no

Author Profile
Annette Stahl
Norwegian University of Science and Technology
Author Profile
Madhan Rajachandran
CSIR National Institute of Oceanography, Goa, India
Author Profile

Abstract

Zooplankton is a key ecological component of aquatic ecosystems. Studying and monitoring the spatial distribution and temporal variability of zooplankton is vital to understanding their community composition and its relation to climate change. Manual methods for analysis are time-consuming and have limitations on the ecological studies of these organisms. Real-time, fast and accurate in situ zooplankton detection and classification remains a challenge. Currently, research focuses on automating zooplankton image classification using handcrafted computer vision techniques and neural network based approaches [1,2]. Most recent approaches adopt deep learning techniques for identification and classification [3,4]. In this paper, we propose the use of Fast Region-based Convolutional Neural Network (Faster R-CNN) for fast and accurate in situ detection and classification of zooplankton groups in underwater images. Faster R-CNN is a region-based object detection framework which combines region proposal and classification in a unified network [5]. Indeed, end-to-end learning reduces overall training time and increases the accuracy of the network. Faster R-CNN has shown state-of-the-art performance on benchmarks such as ImageNet and VOC [6,7]. We perform the experiments over ZooScan, Kaggle, WHOI-Plankton datasets [8,9,10]. We evaluate the performance of our proposed approach of in situ zooplankton identification and classification in terms of detection speed and mean Average Precision (mAP). In addition, we compare the performance of the proposed method with popular detectors such as Single Shot Multibox Detector (SSD) and You Only Look Once (YOLOv3) to demonstrate its efficacy at processing noisy underwater images [11,12]. Results of our evaluation recommend the use of Faster R-CNN for real-time zooplankton image analysis. The ultimate goal of this work is to automate the current manual process exerted in the lab while improving the accuracy and processing speed of an otherwise time-consuming task for marine biologists.