Closes #438 | Add dataloader for ASR-INDOCSC

[zwenyu]

Closes #438

Checkbox

• [x] Confirm that this PR is linked to the dataset issue.
• [x] Create the dataloader script seacrowd/sea_datasets/{my_dataset}/{my_dataset}.py (please use only lowercase and underscore for dataset folder naming, as mentioned in dataset issue) and its __init__.py within {my_dataset} folder.
• [x] Provide values for the _CITATION, _DATASETNAME, _DESCRIPTION, _HOMEPAGE, _LICENSE, _LOCAL, _URLs, _SUPPORTED_TASKS, _SOURCE_VERSION, and _SEACROWD_VERSION variables.
• [x] Implement _info(), _split_generators() and _generate_examples() in dataloader script.
• [x] Make sure that the BUILDER_CONFIGS class attribute is a list with at least one SEACrowdConfig for the source schema and one for a seacrowd schema.
• [x] Confirm dataloader script works with datasets.load_dataset function.
• [x] Confirm that your dataloader script passes the test suite run with python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py or python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py --subset_id {subset_name_without_source_or_seacrowd_suffix}.
• [x] If my dataset is local, I have provided an output of the unit-tests in the PR (please copy paste). This is OPTIONAL for public datasets, as we can test these without access to the data files.

[holylovenia]

A friendly reminder for @khelli07 to review.

[khelli07]

Hi, apparently the data can not be downloaded from my side. Seems like the server is down (?) or the pre-signed URL is invalid (?)

I have already signed up and signed in to the platform. I have questions though. Do we have to log in to download? If yes, please include it in the description.

[ljvmiranda921]

Oh wow that's interesting. It did work the last time I checked this. Hmm, I guess we should make the file LOCAL instead? And then instruct the user to manually download the file and put it in some directory?

[zwenyu]

@khelli07 Yes need to create an account and be logged in, I'll add this in the description. Are you able to download the dataset by running the dataloader script? I'm now getting the same access error when trying to download through here or manually through the dataset landing page, but is still able to download and load the dataset through the script. Tried this after deleting the previous cached copy.

[holylovenia]

@khelli07 Yes need to create an account and be logged in, I'll add this in the description. Are you able to download the dataset by running the dataloader script? I'm now getting the same access error when trying to download through here or manually through the dataset landing page, but is still able to download and load the dataset through the script. Tried this after deleting the previous cached copy.

I managed to download the data from here, @zwenyu. Probably it's a temporary issue?

cc: @khelli07 @ljvmiranda921

[khelli07]

Just ran it again, and it works! Let me take a look a bit more and wrap up the review :)