roatienza / deep-text-recognition-benchmark

PyTorch code of my ICDAR 2021 paper Vision Transformer for Fast and Efficient Scene Text Recognition (ViTSTR)
Apache License 2.0
287 stars 59 forks source link

error in custom data #45

Open MahmoudElsayedMahmoud opened 2 days ago

MahmoudElsayedMahmoud commented 2 days ago

Filtering the images containing characters which are not in opt.character Filtering the images whose label is longer than opt.batch_max_length

dataset_root: ./datasets/lmbd3333333 opt.select_data: [''] opt.batch_ratio: ['1']

dataset_root: ./datasets/lmbd3333333 dataset: sub-directory: /. num samples: 6 num total samples of : 6 x 1.0 (total_data_usage_ratio) = 6 num samples of per batch: 48 x 1.0 (batch_ratio) = 48 Traceback (most recent call last): File "D:\deep-text-recognition-benchmark\train.py", line 319, in train(opt) File "D:\deep-text-recognition-benchmark\train.py", line 43, in train train_dataset = Batch_Balanced_Dataset(opt) File "D:\deep-text-recognition-benchmark\dataset.py", line 81, in init self.dataloader_iter_list.append(iter(_data_loader)) File "C:\Users\user\miniconda3\envs\vitocr\lib\site-packages\torch\utils\data\dataloader.py", line 440, in iter return self._get_iterator() File "C:\Users\user\miniconda3\envs\vitocr\lib\site-packages\torch\utils\data\dataloader.py", line 388, in _get_iterator return _MultiProcessingDataLoaderIter(self) File "C:\Users\user\miniconda3\envs\vitocr\lib\site-packages\torch\utils\data\dataloader.py", line 1038, in init w.start() File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\process.py", line 121, in start self._popen = self._Popen(self) File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\context.py", line 224, in _Popen return _default_context.get_context().Process._Popen(process_obj) File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\context.py", line 336, in _Popen return Popen(process_obj) File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\popen_spawn_win32.py", line 93, in init reduction.dump(process_obj, to_child) File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\reduction.py", line 60, in dump ForkingPickler(file, protocol).dump(obj) TypeError: cannot pickle 'Environment' object

(vitocr) D:\deep-text-recognition-benchmark> (vitocr) D:\deep-text-recognition-benchmark>Traceback (most recent call last): File "", line 1, in File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\spawn.py", line 116, in spawn_main exitcode = _main(fd, parent_sentinel) File "C:\Users\user\miniconda3\envs\vitocr\lib\multiprocessing\spawn.py", line 126, in _main self = reduction.pickle.load(from_parent) EOFError: Ran out of input

roatienza commented 14 hours ago

For non-latin, you may have to modify the character list and therefore the output layer