Closed aliakbars closed 1 year ago
This dataset is a bit noisy at the moment, aside from having inconsistent labeling (numeric vs string), some data has no labels at all. I've sent a PR to that dataset https://github.com/imkarokaro123/karonese/pull/1 in which aside from cleaning the data, also add extra username masking to add some privacy.
@afaji : So, let's just use the one from your fork and move forward with the PR, shall we?
Waiting for this PR to be approved https://github.com/imkarokaro123/karonese/pull/3
Hi @aliakbars : Perhaps we can just use the data from your fork for now, since we couldn't get any update from the author of the dataset
Updated. Should be working properly now, @SamuelCahyawijaya @holylovenia @muhsatrio.
/test dataset=karonese_sentiment
Please name your PR after the issue it closes. You can use the following line: "Closes #ISSUE-NUMBER" where you replace the ISSUE-NUMBER with the one corresponding to your dataset.
Checkbox
nusantara/nusa_datasets/my_dataset/my_dataset.py
(please use only lowercase and underscore for dataset naming)._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_NUSANTARA_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneNusantaraConfig
for the source schema and one for a nusantara schema.datasets.load_dataset
function.python -m tests.test_nusantara --path=nusantara/nusa_datasets/my_dataset/my_dataset.py
.