Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms

It is important to detect negative behavior of animals for breeding in order to improve their health and welfare. In this work, AI is employed to assist individual animal detection and tracking, which enables the future analysis of behavior for individual animals. The study involves animal groups of pigs and laying hens. First, two state-of-the-art deep learning-based Multi-Object Tracking (MOT) methods are investigated, namely Joint Detection and Embedding (JDE) and FairMOT. Both models detect and track individual animals automatically and continuously. Second, a weighted association algorithm is proposed, which is feasible for both MOT methods to optimize the object re-identification (re-ID), thereby improving the tracking performance. The proposed methods are evaluated on manually annotated datasets. The best tracking performance on pigs is obtained by FairMOT with the weighted association, resulting in an IDF1 of 90.3%, MOTA of 90.8%, MOTP of 83.7%, number of identity switches of 14, and an execution rate of 20.48 fps. For the laying hens, FairMOT with the weighted association also achieves the best tracking performance, with an IDF1 of 88.8%, MOTA of 86.8%, MOTP of 72.8%, number of identity switches of 2, and an execution rate of 21.01 fps. These results show a promising high accuracy and robustness for the individual animal tracking

Saved in:
Bibliographic Details
Main Authors: Guo, Qinghua, Sun, Y., Min, Lan, van Putten, Arjen, Knol, E.F., Visser, Bram, Rodenburg, T., Bolhuis, Liesbeth, Bijma, P., de With, P.H.N.
Format: Article in monograph or in proceedings biblioteca
Language:English
Published: SciTePress
Subjects:Life Science,
Online Access:https://research.wur.nl/en/publications/video-based-detection-and-tracking-with-improved-re-identificatio
Tags: Add Tag
No Tags, Be the first to tag this record!
id dig-wur-nl-wurpubs-594363
record_format koha
spelling dig-wur-nl-wurpubs-5943632024-10-30 Guo, Qinghua Sun, Y. Min, Lan van Putten, Arjen Knol, E.F. Visser, Bram Rodenburg, T. Bolhuis, Liesbeth Bijma, P. de With, P.H.N. Article in monograph or in proceedings Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications ISBN: 9789897585555 Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms 2022 It is important to detect negative behavior of animals for breeding in order to improve their health and welfare. In this work, AI is employed to assist individual animal detection and tracking, which enables the future analysis of behavior for individual animals. The study involves animal groups of pigs and laying hens. First, two state-of-the-art deep learning-based Multi-Object Tracking (MOT) methods are investigated, namely Joint Detection and Embedding (JDE) and FairMOT. Both models detect and track individual animals automatically and continuously. Second, a weighted association algorithm is proposed, which is feasible for both MOT methods to optimize the object re-identification (re-ID), thereby improving the tracking performance. The proposed methods are evaluated on manually annotated datasets. The best tracking performance on pigs is obtained by FairMOT with the weighted association, resulting in an IDF1 of 90.3%, MOTA of 90.8%, MOTP of 83.7%, number of identity switches of 14, and an execution rate of 20.48 fps. For the laying hens, FairMOT with the weighted association also achieves the best tracking performance, with an IDF1 of 88.8%, MOTA of 86.8%, MOTP of 72.8%, number of identity switches of 2, and an execution rate of 21.01 fps. These results show a promising high accuracy and robustness for the individual animal tracking en SciTePress application/pdf https://research.wur.nl/en/publications/video-based-detection-and-tracking-with-improved-re-identificatio 10.5220/0010788100003124 https://edepot.wur.nl/564950 Life Science https://creativecommons.org/licenses/by-nc-nd/4.0/ Wageningen University & Research
institution WUR NL
collection DSpace
country Países bajos
countrycode NL
component Bibliográfico
access En linea
databasecode dig-wur-nl
tag biblioteca
region Europa del Oeste
libraryname WUR Library Netherlands
language English
topic Life Science
Life Science
spellingShingle Life Science
Life Science
Guo, Qinghua
Sun, Y.
Min, Lan
van Putten, Arjen
Knol, E.F.
Visser, Bram
Rodenburg, T.
Bolhuis, Liesbeth
Bijma, P.
de With, P.H.N.
Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
description It is important to detect negative behavior of animals for breeding in order to improve their health and welfare. In this work, AI is employed to assist individual animal detection and tracking, which enables the future analysis of behavior for individual animals. The study involves animal groups of pigs and laying hens. First, two state-of-the-art deep learning-based Multi-Object Tracking (MOT) methods are investigated, namely Joint Detection and Embedding (JDE) and FairMOT. Both models detect and track individual animals automatically and continuously. Second, a weighted association algorithm is proposed, which is feasible for both MOT methods to optimize the object re-identification (re-ID), thereby improving the tracking performance. The proposed methods are evaluated on manually annotated datasets. The best tracking performance on pigs is obtained by FairMOT with the weighted association, resulting in an IDF1 of 90.3%, MOTA of 90.8%, MOTP of 83.7%, number of identity switches of 14, and an execution rate of 20.48 fps. For the laying hens, FairMOT with the weighted association also achieves the best tracking performance, with an IDF1 of 88.8%, MOTA of 86.8%, MOTP of 72.8%, number of identity switches of 2, and an execution rate of 21.01 fps. These results show a promising high accuracy and robustness for the individual animal tracking
format Article in monograph or in proceedings
topic_facet Life Science
author Guo, Qinghua
Sun, Y.
Min, Lan
van Putten, Arjen
Knol, E.F.
Visser, Bram
Rodenburg, T.
Bolhuis, Liesbeth
Bijma, P.
de With, P.H.N.
author_facet Guo, Qinghua
Sun, Y.
Min, Lan
van Putten, Arjen
Knol, E.F.
Visser, Bram
Rodenburg, T.
Bolhuis, Liesbeth
Bijma, P.
de With, P.H.N.
author_sort Guo, Qinghua
title Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
title_short Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
title_full Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
title_fullStr Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
title_full_unstemmed Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
title_sort video-based detection and tracking with improved re-identification association for pigs and laying hens in farms
publisher SciTePress
url https://research.wur.nl/en/publications/video-based-detection-and-tracking-with-improved-re-identificatio
work_keys_str_mv AT guoqinghua videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT suny videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT minlan videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT vanputtenarjen videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT knolef videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT visserbram videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT rodenburgt videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT bolhuisliesbeth videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT bijmap videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
AT dewithphn videobaseddetectionandtrackingwithimprovedreidentificationassociationforpigsandlayinghensinfarms
_version_ 1816153388068372480