search

kaist-avelab / K-Radar

4D Radar Object Detection for Autonomous Driving in Various Weather Conditions
309 stars 44 forks source link

The data in NAS is too large. #11

Closed YLRK closed 8 months ago

YLRK commented 1 year ago

Thank you for your great research.

The data in NAS is too large and the download speed is too slow, making it easy to interrupt the download. Can you decompress the data in NAS into small compressed packets? image

kvnptl commented 1 year ago

True, the download speed is just 50KB/s

DekuLiuTesla commented 1 year ago

Yeah, mine is 200-300KB/s but is still too slow for downloading 12T. The sequences from 21-58 on Google Drive seem to contain no RT data. Is there any recommended practice for relatively faster downloading?

LiawWun commented 1 year ago

Have you succeeded in downloading the dataset from their NAS server? Since i'm facing the same issue now.

woo9904 commented 10 months ago

Hello everyone.

I'll reply on their behalf.

First of all, I would like to apologize for the difficulties you've encountered in obtaining the dataset.

Should you require the complete dataset, including the full Tensor data, we suggest a different acquisition method. That is sending the hard disk directly.

We kindly request that you provide us with an external hard disk drive (HDD) with a capacity of 18TB or greater. You can send it through international shipping or purchase it via online platforms like Amazon. This data transfer is strictly non-profit basis and has been utilized by various research institutions and corporations.

If you are interested in receiving the full dataset directly on an external HDD, please send an email to @DongHeePaek or me.

Thank you.

DongHeePaek commented 9 months ago

I am writing to clarify a point that the complete dataset was accessible before the camera-ready deadline. We initially shared it via a local server, acknowledging the slower download speeds from this source. To mitigate this, we offered two alternatives:

Firstly, the dataset has been made available through shipping, a method documented on our GitHub page in the "Sending 4D raw data via shipping" section. This approach has been successfully adopted by various institutions and companies.

Secondly, a partial dataset was shared via Google Drive. Due to its 2TB storage limit and the dataset's size of 16TB, including processed data like the Radar cube, full sharing on this platform was impractical. The associated costs, 119,000 KRW per year for 2TB, meant a total annual cost of 952,000 KRW for 16TB, necessitating eight members to forego personal drive usage and share costs. These constraints led us to recommend the local server or shipping method for full dataset access.

We deeply regret the inconvenience caused by the size of the K-Radar dataset and are committed to providing the best possible support for all shipping inquiries received via email. Should you require the full dataset, please do not hesitate to contact us as mentioned in the "Sending 4D raw data via shipping" section of our GitHub page.