Closed Gyyz closed 5 months ago
Sorry, open a new PR due to previous commit problems from #453
Thank you for updating the commits! I appreciate it. I approved it now. Just waiting for @raileymontalan 's review 👍 then we can merge
Hi @Gyyz, it isn't clear which of the [0, 1, 2] labels here correspond to the [CLEAN, OFFENSIVE, HATE] labels specified in the paper. Could you please specify if accordingly? Thanks.
Hi, @raileymontalan, added a logging.INFO to print the details.
Hi @Gyyz, it isn't clear which of the [0, 1, 2] labels here correspond to the [CLEAN, OFFENSIVE, HATE] labels specified in the paper. Could you please specify if accordingly? Thanks.
Hi, @raileymontalan, added a logging.INFO to print the details.
Hi @Gyyz, after consulting with @holylovenia, we think it would be better for the labels to be the proper class names [CLEAN, OFFENSIVE, HATE] for the SEACrowd schema. I believe the labels for the source schema can be left as is ([0, 1, 2]).
Hi @Gyyz, it isn't clear which of the [0, 1, 2] labels here correspond to the [CLEAN, OFFENSIVE, HATE] labels specified in the paper. Could you please specify if accordingly? Thanks.
Hi, @raileymontalan, added a logging.INFO to print the details.
Hi @Gyyz, after consulting with @holylovenia, we think it would be better for the labels to be the proper class names [CLEAN, OFFENSIVE, HATE] for the SEACrowd schema. I believe the labels for the source schema can be left as is ([0, 1, 2]).
Sure. Will update this shortly.
Closes #309 | Add/Update Dataloader {UIT-ViHSD}
First line PR Message: Closes #{ISSUE_NUMBER}
where you replace the {ISSUE_NUMBER} with the one corresponding to your dataset.
Checkbox
seacrowd/sea_datasets/{my_dataset}/{my_dataset}.py
(please use only lowercase and underscore for dataset folder naming, as mentioned in dataset issue) and its__init__.py
within{my_dataset}
folder._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_LOCAL
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_SEACROWD_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneSEACrowdConfig
for the source schema and one for a seacrowd schema.datasets.load_dataset
function.python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py
orpython -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py --subset_id {subset_name_without_source_or_seacrowd_suffix}
.