argoverse / argoverse-api

Official GitHub repository for Argoverse dataset
https://www.argoverse.org
Other
830 stars 238 forks source link

Is It Possible To Use Merely Part Of The Datasets #319

Open yuxinl915 opened 1 year ago

yuxinl915 commented 1 year ago

To whom it may concern,

Thanks so much for providing the APIs for argoverse! They are amazing! However, I got one question related to our dataset. I am currently replicating a paper and would like to download Argoverse 2 Motion Forecasting Dataset for training and validating. The only available equipment so far is my laptop without discrete graphics. Therefore, I am curious whether there is a way that I can download just part of the dataset. For example, the whole dataset for motion forecasting is in size 58G. So could I download only 1 or 2G of it, which might be a more suitable size for training the model on a laptop? Or could you please give me some advice? I really appreciate any help you can provide!

benjaminrwilson commented 1 year ago

Hi @yuxinl915, please refer to the instructions listed here: https://github.com/argoai/av2-api/blob/main/DOWNLOAD.md. You should be able to download individual scenarios.

An example:

s5cmd --no-sign-request cp s3://argoai-argoverse/av2/motion-forecasting/train/0dfbd3aa-467e-46b7-8da8-ca289132ac28/* ~/Downloads/