Closed BinWang28 closed 4 months ago
Passed check by:
python -m tests.test_seacrowd seacrowd/sea_datasets/malaysia_ai_government/malaysia_ai_government.py --subset_id malaysia_ai_government_gov_my
python -m tests.test_seacrowd seacrowd/sea_datasets/malaysia_ai_government/malaysia_ai_government.py --subset_id malaysia_ai_government_govdocs
python -m tests.test_seacrowd seacrowd/sea_datasets/malaysia_ai_government/malaysia_ai_government.py --subset_id malaysia_ai_government_muftiwp_gov_my
python -m tests.test_seacrowd seacrowd/sea_datasets/malaysia_ai_government/malaysia_ai_government.py --subset_id malaysia_ai_government_myjms_mohe_gov_my
A friendly reminder for @BinWang28 to address the suggestions.
updated with thanks
updated with thanks
Thanks @BinWang28! It seems like all suggestions have been addressed.
PS: I'm merging this PR without waiting for @tellarin's approval due to @tellarin's lack of response.
Title: Closes #421 | Add/Update Dataloader malaysia_ai_government
First line PR Message: Closes #421
Checkbox
seacrowd/sea_datasets/{my_dataset}/{my_dataset}.py
(please use only lowercase and underscore for dataset folder naming, as mentioned in dataset issue) and its__init__.py
within{my_dataset}
folder._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_LOCAL
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_SEACROWD_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneSEACrowdConfig
for the source schema and one for a seacrowd schema.datasets.load_dataset
function.python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py
orpython -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py --subset_id {subset_name_without_source_or_seacrowd_suffix}
.