Brian Isaac Medina brian.k.isaac-medina@durham.ac.uk
Postdoctoral Research Associate
Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark
Isaac-Medina, Brian K.S.; Poyser, Matthew; Organisciak, Daniel; Willcocks, Chris G.; Breckon, Toby P.; Shum, Hubert P.H.
Authors
Matthew Poyser matthew.poyser@durham.ac.uk
Academic Visitor
Daniel Organisciak
Dr Chris Willcocks christopher.g.willcocks@durham.ac.uk
Associate Professor
Professor Toby Breckon toby.breckon@durham.ac.uk
Professor
Dr Hubert Shum hubert.shum@durham.ac.uk
Associate Professor
Abstract
Unmanned Aerial Vehicles (UAV) can pose a major risk for aviation safety, due to both negligent and malicious use. For this reason, the automated detection and tracking of UAV is a fundamental task in aerial security systems. Common technologies for UAV detection include visibleband and thermal infrared imaging, radio frequency and radar. Recent advances in deep neural networks (DNNs) for image-based object detection open the possibility to use visual information for this detection and tracking task. Furthermore, these detection architectures can be implemented as backbones for visual tracking systems, thereby enabling persistent tracking of UAV incursions. To date, no comprehensive performance benchmark exists that applies DNNs to visible-band imagery for UAV detection and tracking. To this end, three datasets with varied environmental conditions for UAV detection and tracking, comprising a total of 241 videos (331,486 images), are assessed using four detection architectures and three tracking frameworks. The best performing detector architecture obtains an mAP of 98.6% and the best performing tracking framework obtains a MOTA of 98.7%. Cross-modality evaluation is carried out between visible and infrared spectrums, achieving a maximal 82.8% mAP on visible images when training in the infrared modality. These results provide the first public multi-approach benchmark for state-of-the-art deep learning-based methods and give insight into which detection and tracking architectures are effective in the UAV domain.
Citation
Isaac-Medina, B. K., Poyser, M., Organisciak, D., Willcocks, C. G., Breckon, T. P., & Shum, H. P. (2021). Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark. . https://doi.org/10.1109/iccvw54120.2021.00142
Conference Name | 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) |
---|---|
Conference Location | Montreal, BC, Canada |
Start Date | Oct 11, 2021 |
End Date | Oct 17, 2021 |
Acceptance Date | Aug 13, 2021 |
Online Publication Date | Nov 24, 2021 |
Publication Date | 2021 |
Deposit Date | Aug 18, 2021 |
Publicly Available Date | Oct 18, 2021 |
Series ISSN | 2473-9936,2473-9944 |
DOI | https://doi.org/10.1109/iccvw54120.2021.00142 |
Files
Accepted Conference Proceeding
(3.7 Mb)
PDF
Copyright Statement
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
You might also like
Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentation
(2023)
Conference Proceeding
Region-based Appearance and Flow Characteristics for Anomaly Detection in Infrared Surveillance Imagery
(2023)
Conference Proceeding
Hierarchical Graph Convolutional Networks for Action Quality Assessment
(2023)
Journal Article
UAV-ReID: A Benchmark on Unmanned Aerial Vehicle Re-Identification in Video Imagery
(2022)
Conference Proceeding
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search