brilliant-ember / YouTube-Channel-Downloader

Takes a channel url and downloads all its videos, description, and playlists to your computer. Now you can backup your personal channel with ease!
The Unlicense
3 stars 0 forks source link

added scrapping layer with tests #19

Closed brilliant-ember closed 2 years ago

brilliant-ember commented 2 years ago

fixes https://github.com/brilliant-ember/YouTube-Channel-Downloader/issues/13

Note that tests do work, however, it some times fail as we get timeouts and the scrapper hangs sometimes. so every once in a while the tests fail.

Sometimes youtube gives us an infinite loading spinner when we try to download dynamic content from a playlist and we don't detect that loading spinner (it's html class is circle and id is spinner-id as of today) and this causes us to exit the playlist prematurely and not scrape the remaining of the videos.

run ` python3 tests/functionality_testing/Scrapper_test.py -k "test_get_playlist_info" which passed normally, but fails when the issue happens (or a user updates their number of videos :smile: )