nicklashansen / tdmpc2

Code for "TD-MPC2: Scalable, Robust World Models for Continuous Control"
https://www.tdmpc2.com
MIT License
343 stars 71 forks source link

About downloading data from huggingface #16

Closed mynsng closed 8 months ago

mynsng commented 8 months ago

Hello, congratulations on the ICLR acceptance.

I've read the paper thoroughly and I'm really grateful for sharing both the model and the data. However, I encountered an error while trying to download the data from Hugging Face, and I have a question about it.

I attempted to download the dataset using the following method:

import datasets
ds = datasets.load_dataset('nicklashansen/tdmpc2')

However, I received the following error:

DataFilesNotFoundError: No (supported) data files found in nicklashansen/tdmpc2

Could it be that I am using the wrong method to download the data? If there is an alternative method, please let me know. Thank you!

nicklashansen commented 8 months ago

Hi @mynsng, thank you!

I'll need to look into whether the dataset is configured correctly for API use, I suspect that I might have missed a step (first time uploading a dataset to huggingface). In the mean time, you should be able to download each shard/chunk of the dataset manually with

wget https://huggingface.co/datasets/nicklashansen/tdmpc2/resolve/main/mt80/chunk_0.pt?download=true

Apologies for the inconvenience!

mynsng commented 8 months ago

It works! Thank you for your efforts!