search

openzim / python-storagelib

S3 Cache wrapper to use within Kiwix/OpenZIM/Offspot projects
GNU General Public License v3.0
1 stars 1 forks source link

Crash on connection error #5

Closed rgaudin closed 6 months ago

rgaudin commented 3 years ago

Seen in https://github.com/openzim/youtube/issues/139

[youtube2zim::2021-01-11 02:31:49,370] ERROR:webm/low/Ouy2ocDbFYs failed to upload to cache: Failed to upload /output/tmpobb8pd_4/videos/Ouy2ocDbFYs/video.webm to org-kiwix-youtube/webm/low/Ouy2ocDbFYs: An error occurred (TemporarilyUnavailable) when calling the CreateMultipartUpload operation (reached max retries: 4): Maximum number of server active requests exceeded
[youtube2zim::2021-01-11 02:31:49,370] DEBUG:Attempting to download thumbnail for Ouy2ocDbFYs from cache...
[youtube2zim::2021-01-11 02:31:58,227] ERROR:FAILED. An error occurred: local variable 'meta' referenced before assignment
[youtube2zim::2021-01-11 02:31:58,227] ERROR:local variable 'meta' referenced before assignment
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/youtube2zim-2.1.12-py3.8.egg/youtube2zim/entrypoint.py", line 202, in main
scraper.run()
File "/usr/local/lib/python3.8/site-packages/youtube2zim-2.1.12-py3.8.egg/youtube2zim/scraper.py", line 294, in run
succeeded, failed = self.download_video_files(
File "/usr/local/lib/python3.8/site-packages/youtube2zim-2.1.12-py3.8.egg/youtube2zim/scraper.py", line 506, in download_video_files
return self.download_video_files_batch(options, self.videos_ids)
File "/usr/local/lib/python3.8/site-packages/youtube2zim-2.1.12-py3.8.egg/youtube2zim/scraper.py", line 698, in download_video_files_batch
if self.download_video(video_id, options) and self.download_thumbnail(
File "/usr/local/lib/python3.8/site-packages/youtube2zim-2.1.12-py3.8.egg/youtube2zim/scraper.py", line 651, in download_thumbnail
if self.download_from_cache(s3_key, thumbnail_path, preset.VERSION):
File "/usr/local/lib/python3.8/site-packages/youtube2zim-2.1.12-py3.8.egg/youtube2zim/scraper.py", line 564, in download_from_cache
if not self.s3_storage.has_object_matching_meta(
File "/usr/local/lib/python3.8/site-packages/kiwixstorage-0.4-py3.8.egg/kiwixstorage/init.py", line 430, in has_object_matching_meta
return meta.get(tag) == value
UnboundLocalError: local variable 'meta' referenced before assignment
stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be now be reviewed manually. Thank you for your contributions.