search

graham-walker / youtube-dl-react-viewer

Web app for youtube-dl/yt-dlp, created using the MERN stack
https://react.gwalkerux.com/
MIT License
92 stars 9 forks source link

Download stuck #21

Closed M4RC02U1F4A4 closed 3 years ago

M4RC02U1F4A4 commented 3 years ago

After a few downloads the download appears stuck In particular, this problem happened to me

This is the log i get form docker-compose logs -f

app_1  | [download] Destination: /youtube-dl/videos/youtube/aajbFO7xwBM/Why SpaceX Bought a Robotic Dog - Primal Space - 20200913.f399.mp4
db_1   | {"t":{"$date":"2021-07-07T22:26:54.075+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625696814:75294][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 61, snapshot max: 61 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:27:54.112+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625696874:112761][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 63, snapshot max: 63 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:28:54.125+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625696934:125143][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 130, snapshot max: 130 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:29:54.141+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625696994:141018][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 132, snapshot max: 132 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:30:54.151+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625697054:151044][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 133, snapshot max: 133 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:31:54.168+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625697114:168045][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 134, snapshot max: 134 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:32:54.175+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625697174:175468][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 135, snapshot max: 135 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-07T22:33:54.185+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625697234:184981][1:0x7fc3ead8e700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 137, snapshot max: 137 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}

The only way to temporarily solve this problem is to restart the container, but after some other downloads the problem return

JamoDevNich commented 3 years ago

Not sure why mongodb is taking a snapshot every minute, that seems pretty unusual.

Could you add VERBOSE=true to the environment section of the compose file, down/up the container and run the job again? This should enable a more detailed log output.

Also, which version of react-viewer are you running?

M4RC02U1F4A4 commented 3 years ago

I tryed with v1.2.1 and 1.3.0

The logs appear to be the same

app_1  | [youtube-dl-exec-script] Successfully inserted document into the database
db_1   | {"t":{"$date":"2021-07-08T06:01:16.287+00:00"},"s":"I",  "c":"-",        "id":20883,   "ctx":"conn49","msg":"Interrupted operation as its client disconnected","attr":{"opId":5734}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.287+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn49","msg":"Connection ended","attr":{"remote":"172.23.0.3:59598","connectionId":49,"connectionCount":15}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.294+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn55","msg":"Connection ended","attr":{"remote":"172.23.0.3:59610","connectionId":55,"connectionCount":14}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.294+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn54","msg":"Connection ended","attr":{"remote":"172.23.0.3:59608","connectionId":54,"connectionCount":13}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.294+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn51","msg":"Connection ended","attr":{"remote":"172.23.0.3:59602","connectionId":51,"connectionCount":12}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.294+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn52","msg":"Connection ended","attr":{"remote":"172.23.0.3:59604","connectionId":52,"connectionCount":11}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.294+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn53","msg":"Connection ended","attr":{"remote":"172.23.0.3:59606","connectionId":53,"connectionCount":10}}
db_1   | {"t":{"$date":"2021-07-08T06:01:16.294+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn50","msg":"Connection ended","attr":{"remote":"172.23.0.3:59600","connectionId":50,"connectionCount":9}}
app_1  | [download] Downloading video 8 of 49
app_1  | [youtube] lHlU7sOuEEI: Downloading webpage
app_1  | WARNING: No subtitle format found matching "srt" for language en, using vtt
app_1  | [info] Writing video description to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.description
app_1  | [info] Writing video subtitles to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.en.vtt
app_1  | WARNING: There are no annotations to write.
app_1  | [info] Writing video description metadata as JSON to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.info.json
app_1  | [youtube] lHlU7sOuEEI: Downloading thumbnail 0 ...
app_1  | [youtube] lHlU7sOuEEI: Writing thumbnail 0 to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.mkv_0.jpg
app_1  | [youtube] lHlU7sOuEEI: Downloading thumbnail 1 ...
app_1  | [youtube] lHlU7sOuEEI: Writing thumbnail 1 to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.mkv_1.jpg
app_1  | [youtube] lHlU7sOuEEI: Downloading thumbnail 2 ...
app_1  | [youtube] lHlU7sOuEEI: Writing thumbnail 2 to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.mkv_2.jpg
app_1  | [youtube] lHlU7sOuEEI: Downloading thumbnail 3 ...
app_1  | [youtube] lHlU7sOuEEI: Writing thumbnail 3 to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.mkv_3.jpg
app_1  | [youtube] lHlU7sOuEEI: Downloading thumbnail 4 ...
app_1  | [youtube] lHlU7sOuEEI: Writing thumbnail 4 to: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.mkv_4.jpg
app_1  | [debug] Invoking downloader on 'https://r5---sn-45nufxc-hm2e.googlevideo.com/videoplayback?expire=1625745676&ei=rJTmYM6TFZXs1wLg5bGoDw&ip=2.238.198.155&id=o-AA5D80Q83ikJjIXrMTfPvvDM-8Crba9MR_rRKRvh2uMj&itag=399&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278%2C394%2C395%2C396%2C397%2C398%2C399&source=youtube&requiressl=yes&mh=Pq&mm=31%2C26&mn=sn-45nufxc-hm2e%2Csn-hgn7rne7&ms=au%2Conr&mv=m&mvi=5&pl=22&initcwndbps=1630000&vprv=1&mime=video%2Fmp4&ns=aGa7NcLkeh098QVlO3Cxn2kG&gir=yes&clen=75379975&dur=616.082&lmt=1606708989814347&mt=1625723805&fvip=5&keepalive=yes&fexp=24001373%2C24007246&c=WEB&txp=5531432&n=Tf_r7_9S1TQSK0&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRAIgb-Uoz8quVKV6IDFtFWsVInDZ7pxtxPEmu5VIndJf-YwCICvwlaNh_QfCvmYI7KhJMYl2AatwS7hsaGX57XWLo00G&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRQIgTLJBKhMRbzF64bPOucK9t0MDz4Mkv0nQ2nu0AXeA5hECIQCFjW2o9KW_58Ay5u22NgPACUKze3QnncTFHwYcW52BEg%3D%3D'
app_1  | [download] Destination: /youtube-dl/videos/youtube/lHlU7sOuEEI/Where Does SpaceX Get Their Rocket Fuel - Primal Space - 20201126.f399.mp4
db_1   | {"t":{"$date":"2021-07-08T06:02:07.458+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724127:458391][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 73, snapshot max: 73 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:03:07.495+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724187:495528][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 75, snapshot max: 75 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}

I made some test and it seems that the downloads are not stuck, but the download speed is reduced drastically after some downloads

app_1  | [download] Downloading video 13 of 49
app_1  | [youtube] Uq6EgZ836iE: Downloading webpage
app_1  | WARNING: No subtitle format found matching "srt" for language zh-CN, using vtt
app_1  | WARNING: No subtitle format found matching "srt" for language en, using vtt
app_1  | WARNING: No subtitle format found matching "srt" for language pt, using vtt
app_1  | [info] Writing video description to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.description
app_1  | [info] Writing video subtitles to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.zh-CN.vtt
app_1  | WARNING: There are no annotations to write.
app_1  | [info] Writing video subtitles to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.en.vtt
app_1  | [info] Writing video subtitles to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.pt.vtt
app_1  | [info] Writing video description metadata as JSON to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.info.json
app_1  | [youtube] Uq6EgZ836iE: Downloading thumbnail 0 ...
app_1  | [youtube] Uq6EgZ836iE: Writing thumbnail 0 to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv_0.jpg
app_1  | [youtube] Uq6EgZ836iE: Downloading thumbnail 1 ...
app_1  | [youtube] Uq6EgZ836iE: Writing thumbnail 1 to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv_1.jpg
app_1  | [youtube] Uq6EgZ836iE: Downloading thumbnail 2 ...
app_1  | [youtube] Uq6EgZ836iE: Writing thumbnail 2 to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv_2.jpg
app_1  | [youtube] Uq6EgZ836iE: Downloading thumbnail 3 ...
app_1  | [youtube] Uq6EgZ836iE: Writing thumbnail 3 to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv_3.jpg
app_1  | [youtube] Uq6EgZ836iE: Downloading thumbnail 4 ...
app_1  | [youtube] Uq6EgZ836iE: Writing thumbnail 4 to: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv_4.jpg
app_1  | [debug] Invoking downloader on 'https://r4---sn-45nufxc-hm2l.googlevideo.com/videoplayback?expire=1625746033&ei=EZbmYOX6KNii1gKCr5fYCA&ip=2.238.198.155&id=o-AFKdcP2Po7n8U0XXUlRZGEBMIcfraRfKjxEVcE5YIIyO&itag=248&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278&source=youtube&requiressl=yes&mh=aI&mm=31%2C26&mn=sn-45nufxc-hm2l%2Csn-hgn7rn7r&ms=au%2Conr&mv=m&mvi=4&pl=22&initcwndbps=1663750&vprv=1&mime=video%2Fwebm&ns=WgCb4sLKLn5YgmC9Y8FREPQG&gir=yes&clen=60906604&dur=402.101&lmt=1594841504948062&mt=1625724289&fvip=4&keepalive=yes&fexp=24001373%2C24007246&c=WEB&txp=5432432&n=dxRO0QvF9YQDj7&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRAIgNB4furm3aWgfTYVS2qk_fF4qjbyJ9zUdpuhTnDiJtWcCIG2GeWs6CXGTCtlaWVGxHgFalMXfPfumN3rniE-fTg-2&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRgIhANwcqQlRyS9jEFFYKzHtSm_SKe_j_iP_dxhEB-90mGDYAiEAit9XU0NsT-47rRk1JsU4BDfyGfspL_p0Fyu2_QGNXas%3D'
app_1  | [download] Destination: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.f248.webm
db_1   | {"t":{"$date":"2021-07-08T06:08:07.605+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724487:605212][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 99, snapshot max: 99 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:09:07.641+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724547:641738][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 102, snapshot max: 102 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:10:07.654+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724607:653994][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 104, snapshot max: 104 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:11:07.664+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724667:664243][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 105, snapshot max: 105 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:12:07.673+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724727:673721][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 106, snapshot max: 106 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:12:26.677+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn16","msg":"Connection ended","attr":{"remote":"172.23.0.3:59526","connectionId":16,"connectionCount":3}}
db_1   | {"t":{"$date":"2021-07-08T06:12:26.678+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn17","msg":"Connection ended","attr":{"remote":"172.23.0.3:59528","connectionId":17,"connectionCount":2}}
db_1   | {"t":{"$date":"2021-07-08T06:13:07.682+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724787:682938][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 107, snapshot max: 107 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:14:07.695+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724847:695334][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 108, snapshot max: 108 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:15:07.703+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724907:703316][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 109, snapshot max: 109 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:16:07.712+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625724967:712363][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 110, snapshot max: 110 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:17:07.722+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725027:722222][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 111, snapshot max: 111 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:18:07.730+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725087:730807][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 112, snapshot max: 112 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:19:07.739+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725147:739221][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 113, snapshot max: 113 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:20:07.748+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725207:748706][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 114, snapshot max: 114 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:21:05.237+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.23.0.3:59682","connectionId":91,"connectionCount":3}}
db_1   | {"t":{"$date":"2021-07-08T06:21:05.237+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn91","msg":"client metadata","attr":{"remote":"172.23.0.3:59682","client":"conn91","doc":{"driver":{"name":"nodejs|Mongoose","version":"3.6.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"4.19.0-17-amd64"},"platform":"'Node.js v15.14.0, LE (unified)","version":"3.6.0|5.10.0"}}}
db_1   | {"t":{"$date":"2021-07-08T06:21:07.757+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725267:757521][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 115, snapshot max: 115 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:22:07.766+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725327:766532][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 116, snapshot max: 116 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:23:07.776+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725387:776827][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 117, snapshot max: 117 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:24:07.786+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725447:786154][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 119, snapshot max: 119 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:25:07.799+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725507:799530][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 121, snapshot max: 121 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
[download] 100% of 58.09MiB in 18:2962KiB/s ETA 00:00:57
app_1  | [debug] Invoking downloader on 'https://r4---sn-45nufxc-hm2l.googlevideo.com/videoplayback?expire=1625746033&ei=EZbmYOX6KNii1gKCr5fYCA&ip=2.238.198.155&id=o-AFKdcP2Po7n8U0XXUlRZGEBMIcfraRfKjxEVcE5YIIyO&itag=251&source=youtube&requiressl=yes&mh=aI&mm=31%2C26&mn=sn-45nufxc-hm2l%2Csn-hgn7rn7r&ms=au%2Conr&mv=m&mvi=4&pl=22&initcwndbps=1663750&vprv=1&mime=audio%2Fwebm&ns=WgCb4sLKLn5YgmC9Y8FREPQG&gir=yes&clen=7274809&dur=402.121&lmt=1594840870305462&mt=1625724289&fvip=4&keepalive=yes&fexp=24001373%2C24007246&c=WEB&txp=5431432&n=dxRO0QvF9YQDj7&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Cgir%2Cclen%2Cdur%2Clmt&sig=AOq0QJ8wRAIgOPEHpcd-Rr36F5MaKHeIc_Sqb_dng3bT-wCKrKktVs0CIHQLdpgH-tcxOHGk26gMBf8VGn-JHk1BQmrmqhLj2U5u&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRgIhANwcqQlRyS9jEFFYKzHtSm_SKe_j_iP_dxhEB-90mGDYAiEAit9XU0NsT-47rRk1JsU4BDfyGfspL_p0Fyu2_QGNXas%3D'
app_1  | [download] Destination: /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.f251.webm
db_1   | {"t":{"$date":"2021-07-08T06:26:07.810+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725567:810023][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 122, snapshot max: 122 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:27:07.819+00:00"},"s":"I",  "c":"STORAGE",  "id":22430,   "ctx":"WTCheckpointThread","msg":"WiredTiger message","attr":{"message":"[1625725627:819684][1:0x7faabdf18700], WT_SESSION.checkpoint: [WT_VERB_CHECKPOINT_PROGRESS] saving checkpoint snapshot min: 123, snapshot max: 123 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0)"}}
db_1   | {"t":{"$date":"2021-07-08T06:27:39.409+00:00"},"s":"I",  "c":"NETWORK",  "id":22944,   "ctx":"conn91","msg":"Connection ended","attr":{"remote":"172.23.0.3:59682","connectionId":91,"connectionCount":2}}
[download] 100% of 6.94MiB in 02:1264KiB/s ETA 00:00
app_1  | [ffmpeg] Merging formats into "/youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv"
app_1  | [debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:/youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.f248.webm' -i 'file:/youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.f251.webm' -c copy -map 0:v:0 -map 1:a:0 'file:/youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.temp.mkv'
app_1  | Deleting original file /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.f248.webm (pass -k to keep)
app_1  | Deleting original file /youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.f251.webm (pass -k to keep)
app_1  | [ffmpeg] Adding metadata to '/youtube-dl/videos/youtube/Uq6EgZ836iE/Is The Future Of Power Wireless - Primal Space - 20200715.mkv'
JamoDevNich commented 3 years ago

I made some test and it seems that the downloads are not stuck, but the download speed is reduced drastically after some downloads

Ouch, 62KiB/s is very, very slow...

It seems like either youtube or your ISP is throttling your download speeds, especially if you've been downloading non-stop for a long period of time

EDIT: Looks like this is a known issue, see here: https://github.com/ytdl-org/youtube-dl/issues/29326

M4RC02U1F4A4 commented 3 years ago

EDIT: Looks like this is a known issue, see here: ytdl-org/youtube-dl#29326

Thanks for pointing me to the right problem

I will wait to see if a permanent solution is found