brilliant-ember / YouTube-Channel-Downloader

Takes a channel url and downloads all its videos, description, and playlists to your computer. Now you can backup your personal channel with ease!
The Unlicense
3 stars 0 forks source link

Youtube gives us infinite loading screen sometimes when we scrap a playlist (did we trip a bot protection mechanism?) #22

Open brilliant-ember opened 2 years ago

brilliant-ember commented 2 years ago

as mentioned in https://github.com/brilliant-ember/YouTube-Channel-Downloader/pull/19 and could be related to https://github.com/brilliant-ember/YouTube-Channel-Downloader/issues/18

Sometimes youtube gives us an infinite loading spinner when we try to download dynamic content from a playlist and we don't detect that loading spinner (it's html class is circle and id is spinner-id as of today) and this causes us to exit the playlist prematurely and not scrape the remaining of the videos.

run ` python3 tests/functionality_testing/Scrapper_test.py -k "test_get_playlist_info" which passed normally, but fails when the issue happens (or a user updates their number of videos :smile: )