hulianyuyy
commented
5 months ago It seems that you should modify the 'dataset-root' hyperparameter in the dataset_preprocess-T.py as you want.
Closed shizukadara closed 5 months ago
hulianyuyy
commented
5 months ago It seems that you should modify the 'dataset-root' hyperparameter in the dataset_preprocess-T.py as you want.
I am trying to preprocess the data with "!python dataset_preprocess-T.py --process-image --multiprocessing" but this is the error it gives. I have created the symbolic link properly and verified it too (!ln -s /mnt/c/Users/Samriddha\ Sanyal/PHOENIX-2014-T-release-v3/PHOENIX-2014-T ./dataset/phoenix2014-T) I have referred to this #10 and moved the files in the features folders into a new "1" subdirectory by executing the script for dev and test although not yet for train.
I am working with phoenix2014-T dataset
Traceback (most recent call last): File "/mnt/c/Users/Samriddha Sanyal/Corrnet-main/preprocess/dataset_preprocess-T.py", line 109, in <module> information = csv2dict(f"{args.dataset_root}/{args.annotation_prefix.format(md)}", dataset_type=md) File "/mnt/c/Users/Samriddha Sanyal/Corrnet-main/preprocess/dataset_preprocess-T.py", line 15, in csv2dict inputs_list = pandas.read_csv(anno_path) File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/util/_decorators.py", line 311, in wrapper return func(*args, **kwargs) File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 586, in read_csv return _read(filepath_or_buffer, kwds) File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 482, in _read parser = TextFileReader(filepath_or_buffer, **kwds) File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 811, in __init__ self._engine = self._make_engine(self.engine) File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/parsers/readers.py", line 1040, in _make_engine return mapping[engine](self.f, **self.options) # type: ignore[call-arg] File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/parsers/c_parser_wrapper.py", line 51, in __init__ self._open_handles(src, kwds) File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/parsers/base_parser.py", line 222, in _open_handles self.handles = get_handle( File "/home/shizuka/anaconda3/envs/corrnet2/lib/python3.9/site-packages/pandas/io/common.py", line 702, in get_handle handle = open( FileNotFoundError: [Errno 2] No such file or directory: '/disk1/dataset/PHOENIX-2014-T-release-v3/PHOENIX-2014-T/annotations/manual/PHOENIX-2014-T.dev.corpus.csv'