RuntimeError: File size unexpectedly exceeded ZIP64 limit in BASELINE

[frj555]

Hi, I found error when runing the baseline by default. It seems ZIP64 limit is exceeded after MMOCR step.

Traceback (most recent call last): File "C:\Users---\anaconda3\envs\tracklab\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Users---\anaconda3\envs\tracklab\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "C:\Program Files\Git\soccernet\tracklab\tracklab\main.py", line 119, in main() File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra\main.py", line 94, in decorated_main _run_hydra( File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra_internal\utils.py", line 394, in _run_hydra _run_app( File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra_internal\utils.py", line 457, in _run_app run_and_report( File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra_internal\utils.py", line 223, in run_and_report raise ex File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra_internal\utils.py", line 220, in run_andreport return func() File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra_internal\utils.py", line 458, in lambda: hydra.run( File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra_internal\hydra.py", line 132, in run = ret.return_value File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra\core\utils.py", line 260, in return_value raise self._return_value File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\hydra\core\utils.py", line 186, in run_job ret.return_value = task_function(task_cfg) File "C:\Program Files\Git\soccernet\tracklab\tracklab\main.py", line 59, in main tracking_engine.track_dataset() File "C:\Program Files\Git\soccernet\tracklab\tracklab\engine\engine.py", line 118, in track_dataset self.callback( File "C:\Users---\anaconda3\envs\tracklab\lib\site-packages\lightning\fabric\fabric.py", line 892, in call method(*args, **kwargs) File "C:\Program Files\Git\soccernet\tracklab\tracklab\datastruct\tracker_state.py", line 233, in on_video_loop_end self.save() File "C:\Program Files\Git\soccernet\tracklab\tracklab\datastruct\tracker_state.py", line 276, in save with self.zf["save"].open(f"{self.video_id}.pkl", "w") as fp: File "C:\Users___\anaconda3\envs\tracklab\lib\zipfile.py", line 1172, in close raise RuntimeError( RuntimeError: File size unexpectedly exceeded ZIP64 limit Tracking videos (SNGS-021) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1/1 10:47:05 • 0:00:00[W C:\cb\pytorch_1000000000000\work\torch\csrc\CudaIPCTypes.cpp:95] Producer process tried to deallocate over 1000 memory blocks referred by consumer processes. Deallocation might be significantly slowed down. We assume it will never going to be the case, but if it is, please file but to https://github.com/pytorch/pytorch [W C:\cb\pytorch_1000000000000\work\torch\csrc\CudaIPCTypes.cpp:15] Producer process has been terminated before all shared CUDA tensors released. See Note [Sharing CUDA tensors] [W CUDAGuardImpl.h:46] Warning: CUDA warning: driver shutting down (function uncheckedGetDevice) [W CUDAGuardImpl.h:62] Warning: CUDA warning: invalid device ordinal (function uncheckedSetDevice) ....

[VlSomers]

Hi @frj555 , is it fixed now? If yes, could you share what you have done?

[frj555]

Hi. I am not 100% sure this issue it is solved but what I did is changing program line in my local drive, in File "C:\Program Files\Git\soccernet\tracklab\tracklab\datastruct\tracker_state.py", line 276, in save, adding ", force_zip64=True" :

• Original line 276: with self.zf["save"].open(f"{self.video_id}.pkl", "w") as fp:
• New line 276: with self.zf["save"].open(f"{self.video_id}.pkl", "w", force_zip64=True) as fp:

I will update if this issue appears again. Many thanks.