search

allenai / satlas

Apache License 2.0
184 stars 19 forks source link

No json file #18

Closed HuangShiqi128 closed 9 months ago

HuangShiqi128 commented 10 months ago

Hi,

I couldn't find

Additional` files in satlas/metadata/ contain extra data. train_highres.json, train_lowres.json, test_event.json, test_highres.json, train_lowres.json, test_event.json enumerate the tiles assigned to each split.

May I ask where it is?

favyen2 commented 10 months ago

It should be in the dataset download (https://github.com/allenai/satlas/blob/main/SatlasPretrain.md#satlaspretrain-dataset) specifically the satlas-dataset-v1-metadata.tar file, do you not see it there?

nilsleh commented 3 months ago

Sorry to open this again @favyen2 , but I actually cannot find the metadata tarball on huggingface and I tried:

hf_hub_download(repo_id="allenai/satlas-pretrain", filename="satlas-dataset-v1-metadata.tar")
Entry Not Found for url: https://huggingface.co/allenai/satlas-pretrain/resolve/main/satlas-dataset-v1-metadata.tar.

and

hf_hub_download(repo_id="allenai/satlas-pretrain", filename="dataset/satlas-dataset-v1-metadata.tar")
Entry Not Found for url: https://huggingface.co/allenai/satlas-pretrain/resolve/main/dataset/satlas-dataset-v1-metadata.tar.
favyen2 commented 3 months ago

Here it is https://huggingface.co/allenai/satlas-pretrain/blob/main/dataset/satlaspretrain_dataset_metadata_0000.tar

You can also use the URLs here https://github.com/allenai/satlas/blob/main/satlaspretrain_urls.txt