New publication on object detection models for locating and classifying flower‑visiting arthropods in images

New publication on object detection models for locating and classifying flower‑visiting arthropods in images

September 30, 2023

New publication on object detection models for locating and classifying flowervisiting arthropods in images

 

Researchers from the Earth Observation Center (EOC) of the German Aerospace Center (DLR) in Oberpfaffenhofen, the Department of Community Ecology of the Helmholtz Centre for Environmental Research (UFZ) in Halle, the German Centre for Integrative Biodiversity Research (iDiv) in Halle-Jena-Leipzig, the Institute of Biology of the Martin Luther University Halle-Wittenberg in Halle and our Earth Observation Research Cluster of the University of Würzburg teamed up for a study on object detection models for locating and classifying flowervisiting arthropods in images. The paper titled “YOLO object detection models can locate and classify broad groups of flowervisiting arthropods in images” was just published in the Scientific Reports journal by Thomas Stark, Valentin Ştefan, Michael Wurm, Robin Spanier, Hannes Taubenböck and Tiffany M. Knight. This study has been conducted as part of the project “Pollination Artificial Intelligence (PAI)” funded by the Helmholtz AI initiative (Information & Data Science) Pollination Artificial Intelligence (ZT-I-PF-5-115), lead by Prof. Tiffany M. Knight and Prof. Hannes Taubenböck.

 

Here is the abstract: Development of image recognition AI algorithms for flower-visiting arthropods has the potential to revolutionize the way we monitor pollinators. Ecologists need light-weight models that can be deployed in a field setting and can classify with high accuracy. We tested the performance of three deep learning light-weight models, YOLOv5nano, YOLOv5small, and YOLOv7tiny, at object recognition and classification in real time on eight groups of flower-visiting arthropods using open-source image data. These eight groups contained four orders of insects that are known to perform the majority of pollination services in Europe (Hymenoptera, Diptera, Coleoptera, Lepidoptera) as well as other arthropod groups that can be seen on flowers but are not typically considered pollinators (e.g., spiders-Araneae). All three models had high accuracy, ranging from 93 to 97%. Intersection over union (IoU) depended on the relative area of the bounding box, and the models performed best when a single arthropod comprised a large portion of the image and worst when multiple small arthropods were together in a single image. The model could accurately distinguish flies in the family Syrphidae from the Hymenoptera that they are known to mimic. These results reveal the capability of existing YOLO models to contribute to pollination monitoring.

 

Here is the link to the full paper: https://www.nature.com/articles/s41598-023-43482-3#Sec11

 

you may also like:

New staff member Luisa Pflumm

New staff member Luisa Pflumm

Luisa Pflumm joined the Earth Observation Research Cluster in May 2024 as part of the EcoGlob project and is working with the UAS team in the context of remote sensing for biodiversity and nature conservation. She received her Bachelor's degree in Geography from the...

New team member: Ása Dögg Adalsteinsdottir

New team member: Ása Dögg Adalsteinsdottir

Ása Dögg Adalsteinsdottir joined the Earth Observation Research Cluster in May 2024 as a member of the EO4CAM project team. After earning a bachelor's degree in geography from the University of Iceland, she moved to Germany to study in our EAGLE master's program. She...

NEW TEAM MEMBER: CHRISTIAN SCHÄFER

NEW TEAM MEMBER: CHRISTIAN SCHÄFER

Christian Schäfer joined the EO4CAM project in May 2024. He received his Master's degree in 2017 from Julius-Maximilians-Universität Würzburg (JMU), focusing on GIS-based synthesis of transboundary soil maps. During his work in the JMU BigData@Geo project, he enhanced...

GGW talk on geodata, mobility and social media

GGW talk on geodata, mobility and social media

On Monday the 13th of May our PhD students Ariane Droin and Johannes Mast were holding a talk at the Geographische Gesellschaft Würzburg organised by the Fachschaft Geographie about 'Geodaten, Mobilität und soziale Medien. Big data und die lokale Perspektive der...

NetCDA kick-off workshop

NetCDA kick-off workshop

Yesterday, on May 16th, the partners of the project "European Academic Network for Capacity Development in Climate Change Adaptations in Africa" (NetCDA) met to jointly and officially kick-off their project. The NetCDA team at the University of Würzburg invited all...