search

rfcx / arbimon

Ecoacoustic analysis platform empowering conservationists to analyze acoustic data and to derive insights about the ecosystem at scale
https://arbimon.org
Apache License 2.0
4 stars 1 forks source link

Check project backup errors #2023

Closed koonchaya closed 3 months ago

koonchaya commented 3 months ago

Additional task - this would be for someone from Arbimon team taking over.

  • Change the error message to be shorter (Error downloading file with recording_id 7458327: [THE_ACTUAL_ERROR]) by editing the scripts. See original error Error downloading file with recording_id 7458327 from https://rfcx-streams-staging.s3.eu-west-1.amazonaws.com/2022/08/29/jfg2agt1wz6j/3c747887-ac7c-453d-aeb8-fcca66619c76.opus?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA45B7YWBXZ3ELSJVT%2F20240604%2Feu-west-1%2Fs3%2Faws4_request&X-Amz-Date=20240604T091017Z&X-Amz-Expires=604800&X-Amz-Signature=1b18bf692e7434e7111229d41cbd9cdb97ed0061a8858ef1e19d4c13fc49241b&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3D3c747887-ac7c-453d-aeb8-fcca66619c76.opus&x-id=GetObject: [Errno 17] File exists: '/Users/koonchayaopastipakorn/Downloads/Projectbackup3/the-green-place_2024-06-04_export/recordings/8847'

  • Time mismatch error - this case stopped the download and the the recordings folder is empty Error downloading file with recording_id 157067182 from https://rfcx-streams-production.s3.eu-west-1.amazonaws.com/2018/12/04/womc255ubsqu/d04a6370-af04-4a9e-96c6-337ca0e3875b.flac?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA45B7YWBX5HAZMGOU%2F20240530%2Feu-west-1%2Fs3%2Faws4_request&X-Amz-Date=20240530T045610Z&X-Amz-Expires=604800&X-Amz-Signature=4366d91a0203969ebfcf5f04068319b1b1281aeb17b9e3daa9a86b776c5b795c&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dd04a6370-af04-4a9e-96c6-337ca0e3875b.flac&x-id=GetObject: [Errno 17] File exists: '/Users/koonchayaopastipakorn/Downloads/Projectbackup4/testproject/recordings/51186' recordings.csv recordings.downloaded.txt

Originally posted by @koonchaya in #1943

Additional case from Carly https://rfcx.slack.com/archives/C03FD1WD02J/p1717455092184479?thread_ts=1717103198.366749&cid=C03FD1WD02J

koonchaya commented 3 months ago

I tested on one of my project and did not find the error.

Image

I am testing another project. Result from another project download works fine without any error message.

Image

koonchaya commented 3 months ago

@carlybatist This is the example of the shorten error message

Image

carlybatist commented 3 months ago

@carlybatist This is the example of the shorten error message

Image

awesome, thanks for checking on that!

grindarius commented 3 months ago

Released on v1.4.0