Closed jensan-1 closed 1 year ago
/test dataset=librivox
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3068327121
It looks good. It needs some clean up of the doc and TODO string. It would be also nice to add the streaming functionality and to keep the dataset name "Librivox-Indonesia" as it is in the source dataset. Thanks.
Hello @cahya-wirawan, thank you for the reviews and comments. I have updated the implementations accordingly.
Closes #246
Please name your PR after the issue it closes. You can use the following line: "Closes #ISSUE-NUMBER" where you replace the ISSUE-NUMBER with the one corresponding to your dataset.
Checkbox
nusantara/nusa_datasets/my_dataset/my_dataset.py
(please use only lowercase and underscore for dataset naming)._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_NUSANTARA_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneNusantaraConfig
for the source schema and one for a nusantara schema.datasets.load_dataset
function.python -m tests.test_nusantara --path=nusantara/nusa_datasets/my_dataset/my_dataset.py
.