Closed cahya-wirawan closed 1 year ago
This nergrit dataset is more comprehensive than the indonlu_nergrit dataset. It also contains three subset datasets NER, Sentiment, and Statement. Following is the comparison:
indonlu_nergrit:
nergrit:
/test dataset=nergrit subset_id=nergrit_ner
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3163009802
/test dataset=nergrit subset_id=nergrit_sentiment
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3163027504
/test dataset=nergrit subset_id=nergrit_statement
Check test log here: https://github.com/IndoNLP/nusa-crowd/actions/runs/3163033929
Please name your PR after the issue it closes. You can use the following line: "Closes #ISSUE-NUMBER" where you replace the ISSUE-NUMBER with the one corresponding to your dataset.
Checkbox
nusantara/nusa_datasets/my_dataset/my_dataset.py
(please use only lowercase and underscore for dataset naming)._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_NUSANTARA_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneNusantaraConfig
for the source schema and one for a nusantara schema.datasets.load_dataset
function.python -m tests.test_nusantara --path=nusantara/nusa_datasets/my_dataset/my_dataset.py
.