Closed akhdanfadh closed 4 months ago
Hi @akhdanfadh, I would like to let you know that we plan to finalize the calculation of the open contributions (e.g., dataloader implementations) in 31 hours, so it'd be great if we could wrap up the reviewing and merge this PR before then.
cc: @sabilmakbar
hi @akhdanfadh, since the change is small (rather negligible) and the deadline is approaching, I'm aiding to address my earlier comment as commit. lmk if that was intentional (and we can revert it later). thanks!
will merge this now cc @ljvmiranda921 @holylovenia
Closes #621
Local dataset test result screenshot:
Full test result:
``` (seacrowd) ➜ seacrowd-datahub git:(vlogqa) ✗ python -m tests.test_seacrowd seacrowd/sea_datasets/vlogqa/vlogqa.py --data_dir=data/vlogqa INFO:__main__:args: Namespace(path='seacrowd/sea_datasets/vlogqa/vlogqa.py', schema=None, subset_id=None, data_dir='data/vlogqa', use_auth_token=None) INFO:__main__:self.PATH: seacrowd/sea_datasets/vlogqa/vlogqa.py INFO:__main__:self.SUBSET_ID: vlogqa INFO:__main__:self.SCHEMA: None INFO:__main__:self.DATA_DIR: data/vlogqa INFO:__main__:Checking for _SUPPORTED_TASKS ... module seacrowd.sea_datasets.vlogqa.vlogqa INFO:__main__:Found _SUPPORTED_TASKS=[Checkbox
seacrowd/sea_datasets/my_dataset/my_dataset.py
(please use only lowercase and underscore for dataset naming)._CITATION
,_DATASETNAME
,_DESCRIPTION
,_HOMEPAGE
,_LICENSE
,_URLs
,_SUPPORTED_TASKS
,_SOURCE_VERSION
, and_SEACROWD_VERSION
variables._info()
,_split_generators()
and_generate_examples()
in dataloader script.BUILDER_CONFIGS
class attribute is a list with at least oneSEACrowdConfig
for the source schema and one for a seacrowd schema.datasets.load_dataset
function.python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py
.