meta_data folder is missing

[wonjiny]

Error

/all-in-one$ python run.py with data_root/datasets/msvd/data num_gpus=2 num_nodes=1 num_frames=3 per_gpu_batchsize=16 task_finetune_msvdqa load_path="pretrained/all-in-one-base.ckpt"

....

video datasets: ['msvd_qa_train'] frames for base dataset is: 3 no arrow available for msvd_qa_train, load from disk initalize data augmentation for a100 gpus initalize data augmentation for a100 gpus convert to numpy ERROR - AllInOne - Failed after 0:00:11! Traceback (most recent calls WITHOUT Sacred internals): File "run.py", line 84, in main trainer.fit(model, datamodule=dm) File "/home/miniconda3/envs/allinone/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 473, in fit results = self.accelerator_backend.train() File "/home/miniconda3/envs/allinone/lib/python3.7/site-packages/pytorch_lightning/accelerators/ddp_accelerator.py", line 152, in train results = self.ddp_train(process_idx=self.task_idx, model=model) File "/home/miniconda3/envs/allinone/lib/python3.7/site-packages/pytorch_lightning/accelerators/ddp_accelerator.py", line 268, in ddp_train self.trainer.call_setup_hook(model) File "/home/miniconda3/envs/allinone/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 859, in call_setup_hook self.datamodule.setup(stage_name) File "/home/miniconda3/envs/allinone/lib/python3.7/site-packages/pytorch_lightning/core/datamodule.py", line 92, in wrapped_fn return fn(*args, *kwargs) File "/home/all-in-one/AllInOne/datamodules/multitask_datamodule.py", line 34, in setup dm.setup(stage) File "/home/miniconda3/envs/allinone/lib/python3.7/site-packages/pytorch_lightning/core/datamodule.py", line 92, in wrapped_fn return fn(args, **kwargs) File "/home/all-in-one/AllInOne/datamodules/msvdqa_datamodule.py", line 19, in setup super().setup(stage) File "/home/all-in-one/AllInOne/datamodules/datamodule_base.py", line 157, in setup self.set_train_dataset() File "/home/all-in-one/AllInOne/datamodules/datamodule_base.py", line 92, in set_train_dataset backend=self.backend File "/home/all-in-one/AllInOne/datasets/msvdqa.py", line 28, in init self._load_metadata() File "/home/all-in-one/AllInOne/datasets/msvdqa.py", line 41, in _load_metadata with open(os.path.join(metadata_dir, 'msvd_youtube_mapping.txt')) as f: FileNotFoundError: [Errno 2] No such file or directory: './meta_data/msvd/msvd_youtube_mapping.txt'

Hi.

I think meta_data folder is not uploaded. When I check the code, there is no writing/generation for meta_data files, so I guess meta_data files would be included in the repository. As the DemoVLP does.

DemoVLP has meta_data folder. https://github.com/showlab/DemoVLP/tree/master/meta_data

[FingerRec]

Hi, please follow the last section of https://github.com/showlab/all-in-one/blob/main/DATA.md carefully.

[wonzin]

Thank you I missed the part!

4. Soft Link and Meta Data It is clear :)