Insect interaction analysis based on object detection and CNN

Direct observation to study biodiversity can be time consuming, however, other methods often provide indirect measurements and are possibly biased. To solve these problems, images can be a useful tool and ecologists have started to rely more and more on images as a source of data and on automated image analysis. However, the existing methods mostly perform image classification. In this paper we present an efficient method based on object detection to access deeper information the content of an image. Using high resolution images, we built a pipeline to slice the original images, perform detections and later refine these observations. We illustrate the interest of this pipeline by using it on-field images taken in agroforestery banana-coffee systems to study invertebrate communities around the banana pests Cosmopolites sodidus and Metamasius sp. and the interactions between the different animals within this community. Experimental results show that our pipeline reaches 87.8% F1- score and allows us to successfully detect and identify 23 species and ant castes. These 23 species are divided into 7 superclasses, but the ant super-class, that shows more individuals and interactions is described more precisely. We are then able to study the interaction network between different species of this community and identify major predators of banana pests within this ecosystem.

Saved in:
Bibliographic Details
Main Authors: Tresson, Paul, Tixier, Philippe, Puech, William, Carval, Dominique
Format: conference_item biblioteca
Language:eng
Published: IEEE
Online Access:http://agritrop.cirad.fr/605045/
http://agritrop.cirad.fr/605045/7/ID605045.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id dig-cirad-fr-605045
record_format koha
spelling dig-cirad-fr-6050452024-01-29T10:19:52Z http://agritrop.cirad.fr/605045/ http://agritrop.cirad.fr/605045/ Insect interaction analysis based on object detection and CNN. Tresson Paul, Tixier Philippe, Puech William, Carval Dominique. 2019. In : 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP 2019). IEEE. New York : IEEE, 88-93. ISBN 978-1-7281-1818-5 International Workshop on Multimedia Signal Processing (MMSP 2019). 21, Kuala Lumpur, Malaisie, 27 Septembre 2019/29 Septembre 2019.https://doi.org/10.1109/MMSP.2019.8901798 <https://doi.org/10.1109/MMSP.2019.8901798> Insect interaction analysis based on object detection and CNN Tresson, Paul Tixier, Philippe Puech, William Carval, Dominique eng 2019 IEEE 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP 2019) Direct observation to study biodiversity can be time consuming, however, other methods often provide indirect measurements and are possibly biased. To solve these problems, images can be a useful tool and ecologists have started to rely more and more on images as a source of data and on automated image analysis. However, the existing methods mostly perform image classification. In this paper we present an efficient method based on object detection to access deeper information the content of an image. Using high resolution images, we built a pipeline to slice the original images, perform detections and later refine these observations. We illustrate the interest of this pipeline by using it on-field images taken in agroforestery banana-coffee systems to study invertebrate communities around the banana pests Cosmopolites sodidus and Metamasius sp. and the interactions between the different animals within this community. Experimental results show that our pipeline reaches 87.8% F1- score and allows us to successfully detect and identify 23 species and ant castes. These 23 species are divided into 7 superclasses, but the ant super-class, that shows more individuals and interactions is described more precisely. We are then able to study the interaction network between different species of this community and identify major predators of banana pests within this ecosystem. conference_item info:eu-repo/semantics/conferenceObject Conference info:eu-repo/semantics/publishedVersion http://agritrop.cirad.fr/605045/7/ID605045.pdf text Cirad license info:eu-repo/semantics/restrictedAccess https://agritrop.cirad.fr/mention_legale.html https://doi.org/10.1109/MMSP.2019.8901798 10.1109/MMSP.2019.8901798 https://catalogue-bibliotheques.cirad.fr/cgi-bin/koha/opac-detail.pl?biblionumber=222339 info:eu-repo/semantics/altIdentifier/doi/10.1109/MMSP.2019.8901798 info:eu-repo/semantics/altIdentifier/purl/https://doi.org/10.1109/MMSP.2019.8901798
institution CIRAD FR
collection DSpace
country Francia
countrycode FR
component Bibliográfico
access En linea
databasecode dig-cirad-fr
tag biblioteca
region Europa del Oeste
libraryname Biblioteca del CIRAD Francia
language eng
description Direct observation to study biodiversity can be time consuming, however, other methods often provide indirect measurements and are possibly biased. To solve these problems, images can be a useful tool and ecologists have started to rely more and more on images as a source of data and on automated image analysis. However, the existing methods mostly perform image classification. In this paper we present an efficient method based on object detection to access deeper information the content of an image. Using high resolution images, we built a pipeline to slice the original images, perform detections and later refine these observations. We illustrate the interest of this pipeline by using it on-field images taken in agroforestery banana-coffee systems to study invertebrate communities around the banana pests Cosmopolites sodidus and Metamasius sp. and the interactions between the different animals within this community. Experimental results show that our pipeline reaches 87.8% F1- score and allows us to successfully detect and identify 23 species and ant castes. These 23 species are divided into 7 superclasses, but the ant super-class, that shows more individuals and interactions is described more precisely. We are then able to study the interaction network between different species of this community and identify major predators of banana pests within this ecosystem.
format conference_item
author Tresson, Paul
Tixier, Philippe
Puech, William
Carval, Dominique
spellingShingle Tresson, Paul
Tixier, Philippe
Puech, William
Carval, Dominique
Insect interaction analysis based on object detection and CNN
author_facet Tresson, Paul
Tixier, Philippe
Puech, William
Carval, Dominique
author_sort Tresson, Paul
title Insect interaction analysis based on object detection and CNN
title_short Insect interaction analysis based on object detection and CNN
title_full Insect interaction analysis based on object detection and CNN
title_fullStr Insect interaction analysis based on object detection and CNN
title_full_unstemmed Insect interaction analysis based on object detection and CNN
title_sort insect interaction analysis based on object detection and cnn
publisher IEEE
url http://agritrop.cirad.fr/605045/
http://agritrop.cirad.fr/605045/7/ID605045.pdf
work_keys_str_mv AT tressonpaul insectinteractionanalysisbasedonobjectdetectionandcnn
AT tixierphilippe insectinteractionanalysisbasedonobjectdetectionandcnn
AT puechwilliam insectinteractionanalysisbasedonobjectdetectionandcnn
AT carvaldominique insectinteractionanalysisbasedonobjectdetectionandcnn
_version_ 1792500562366824448