Closed ziweiji closed 1 year ago
python -m tests.test_nusantara nusacrowd/nusa_datasets/indsp_teldialog_lvcsr/indsp_teldialog_lvcsr.py --subset_id indsp_teldialog_lvcsr
/test dataset=liputan6
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3160588702
/test dataset=liputan6 subset_id=liputan6_canonical
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3160615466
/test dataset=indsp_teldialog_lvcsr
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3160655781
/test dataset=indsp_teldialog_lvcsr
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3160710538
The liputan6 & indsp_teldialog_lvcsr datasets looks good btw
/test dataset=indsp_news_ethnicsr subset_id=indsp_news_ethnicsr_Jawa_1
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3167636054
@ziweiji hi, I was wondering if you can make minor changes requested by @holylovenia It would be great if you can make it. Thanks!
/test dataset=indsp_news_ethnicsr subset_id=indsp_news_ethnicsr_jv_overlap
/test dataset=indsp_news_ethnicsr subset_id=indsp_news_ethnicsr_jv_nooverlap
Please name your PR after the issue it closes. You can use the following line: "Closes #ISSUE-NUMBER" where you replace the ISSUE-NUMBER with the one corresponding to your dataset.
Checkbox
nusantara/nusa_datasets/my_dataset/my_dataset.py
(please use only lowercase and underscore for dataset naming)._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_NUSANTARA_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneNusantaraConfig
for the source schema and one for a nusantara schema.datasets.load_dataset
function.python -m tests.test_nusantara --path=nusantara/nusa_datasets/my_dataset/my_dataset.py
.