ntu-aris / MMAUD

This package provides A Comprehensive Multi-Modal Anti-UAV Dataset
MIT License
38 stars 7 forks source link

Common COTS Drone Types in Market

MMAUD: A Comprehensive Multi-Modal Anti-UAV Dataset for Detection, Classification, Tracking and Trajectory Estimation of Compact Commercially Available Drones Threats

This site presents the datasets collected from our research platform, featuring an extensive set of sensors:

Citation

If you use some resource from this data suite, please cite it as

@INPROCEEDINGS{yuan2024MMAUD,
  author={Yuan, Shenghai and Yang, Yizhuo and Nguyen, Thien Hoang and Nguyen, Thien-Minh and Yang, Jianfei and Liu, Fen and Li, Jianping and Wang, Han and Xie, Lihua},
  booktitle={2024 IEEE International Conference on Robotics and Automation (ICRA)}, 
  title={MMAUD: A Comprehensive Multi-Modal Anti-UAV Dataset for Modern Miniature Drone Threats}, 
  year={2024},
  pages={2745-2751},
  doi={10.1109/ICRA57147.2024.10610957}
}

Downloads

The files below are hosted on OneDrive. If you are having a problem downloading from one drive, do raise an issue.

Note: All rosbag data has been compressed using 'rosbag compress' to reduce its size by a factor of 3. If you directly run 'rosbag play,' the playback frequency will be reduced. To restore the bag to its full rate, please use the 'rosbag decompress' command.

Name ROSBag Data Folder Data Ground truth Size Duration Remark
DJI Mavic2 .bag .zip .bag 14.1 GB 198s MMAUD V1 Rooftop Simple
DJI Mavic3 .bag .zip .bag 11.1 GB 321.1 s MMAUD V1 Rooftop Simple
DJI Phantom4 .bag .zip .bag 13.2 GB 181.4 s MMAUD V1 Rooftop Simple
DJI Avata .bag .zip .bag 19.7 GB 396.3 s MMAUD V1 Rooftop Simple
DJI M300 .bag .zip .bag 14.4 GB 428.7 s MMAUD V1 Rooftop Simple
DJI Mavic3 .bag .zip .bag ?? GB ?? s MMAUD V2 Carpark Hard
DJI Phantom4 .bag .zip .bag ?? GB ?? s MMAUD V2 Carpark Hard
DJI Avata .bag .zip .bag ?? GB ?? s MMAUD V2 Carpark Hard
DJI M300 .bag .zip .bag ?? GB ?? s MMAUD V2 Carpark Hard
DJI Mavic3 .bag .zip .bag ?? GB ?? s MMAUD V3 Carpark Moderate
DJI Phantom4 .bag .zip .bag ?? GB ?? s MMAUD V3 Carpark Moderate
DJI Avata .bag .zip .bag ?? GB ?? s MMAUD V3 Carpark Moderate
DJI M300 .bag .zip .bag ?? GB ?? s MMAUD V3 Carpark Moderate

Data used in this project

V2 and V3 were used for the CVPR UG2+ challenge, which is more challenging than V1. V1 mostly flies below 30m, while V2 and V3 are designed for actual warfare simulation, reaching up to 70m. UAV Precision hits are unlikely to go beyond 70m. The results of the UG2 CVPR 2024 challenge are now available.

Quick use

We have done some experiments of state-of-the-art methods on our the datasets. If you are seeking to do the same, please check out the following to get the work done quickly.

2D Detection Repository Credit
YoloV5 Paper under Review, not yet open Forked from https://github.com/ultralytics/yolov5
YoloX Paper under Review, not yet open Forked from https://github.com/Megvii-BaseDetection/YOLOX
CenterNet Paper under Review, not yet open Forked from https://github.com/xingyizhou/CenterNet
SSD Paper under Review, not yet open Forked from https://github.com/amdegroot/ssd.pytorch
M2Det Paper under Review, not yet open Forked from https://github.com/VDIGPKU/M2Det

 2D Detection Result Graph

 2D Detection Result Visual

3D Pose Estimation Repository Credit
ResNet Paper under Review, not yet open Forked from https://github.com/Lornatang/ResNet-PyTorch
VGG Paper under Review, not yet open Forked from https://github.com/Lornatang/VGG-PyTorch
Darknet Paper under Review, not yet open Forked from https://github.com/pjreddie/darknet
Audio Transformer Paper under Review, not yet open Reimplemented
VorasNet Paper under Review, not yet open Reimplemented

CAD drawing for dataset expansion

The CAD drawing can be found here.

Since there are multiple ethernet devices. It is recommended to set 2 livox lidar and MMwave radar to be at 192.168.10.xx , 192.168.11.xx , and 192.168.12.xx.

The microphone and camera can be obtained from Taobao. Whereas other LIDAR and RADAR need to find your local distributor to get it.

If you have any issues in recreating this rig, feel free to drop an issue in this dataset repo

Notes:

For more information on the sensors and how to use the dataset, please checkout the other sections.

For resources and other works of our group please checkout our github.

If you have some inquiry, please raise an issue on github.

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License and is intended for non-commercial academic use. If you are interested in using the dataset for commercial purposes please contact us.