Closed zwenyu closed 4 months ago
A friendly reminder for @khelli07 to review.
Hi, apparently the data can not be downloaded from my side. Seems like the server is down (?) or the pre-signed URL is invalid (?)
I have already signed up and signed in to the platform. I have questions though. Do we have to log in to download? If yes, please include it in the description.
Oh wow that's interesting. It did work the last time I checked this. Hmm, I guess we should make the file LOCAL
instead? And then instruct the user to manually download the file and put it in some directory?
@khelli07 Yes need to create an account and be logged in, I'll add this in the description. Are you able to download the dataset by running the dataloader script? I'm now getting the same access error when trying to download through here or manually through the dataset landing page, but is still able to download and load the dataset through the script. Tried this after deleting the previous cached copy.
@khelli07 Yes need to create an account and be logged in, I'll add this in the description. Are you able to download the dataset by running the dataloader script? I'm now getting the same access error when trying to download through here or manually through the dataset landing page, but is still able to download and load the dataset through the script. Tried this after deleting the previous cached copy.
I managed to download the data from here, @zwenyu. Probably it's a temporary issue?
cc: @khelli07 @ljvmiranda921
Just ran it again, and it works! Let me take a look a bit more and wrap up the review :)
Closes #438
Checkbox
seacrowd/sea_datasets/{my_dataset}/{my_dataset}.py
(please use only lowercase and underscore for dataset folder naming, as mentioned in dataset issue) and its__init__.py
within{my_dataset}
folder._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_LOCAL
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_SEACROWD_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneSEACrowdConfig
for the source schema and one for a seacrowd schema.datasets.load_dataset
function.python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py
orpython -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py --subset_id {subset_name_without_source_or_seacrowd_suffix}
.