brilliant-ember / YouTube-Channel-Downloader

Takes a channel url and downloads all its videos, description, and playlists to your computer. Now you can backup your personal channel with ease!
The Unlicense
3 stars 0 forks source link

investigate using a bot-detection prevention browser and measures #18

Open brilliant-ember opened 2 years ago

brilliant-ember commented 2 years ago

https://github.com/wkeeling/selenium-wire#bot-detection

we can add an action chain user actions randomizer, flip user agents, proxy, changing user agent and other things to reduce bot-detection rates.

brilliant-ember commented 2 years ago

Also instead of directly iterating through the videos one by one we could use random sampling from the all uploads object.

Moreover, if we stopped downloading a channel videos midway we will go through the channel videos one by one and skip the ones the we already downloaded, this is not the most efficient way since the videos are downloaded in order (*should), maybe i can use a binary search, and pop the videos I verified and then at the end the videos I didn't verify I can do a full like scan on the videos that the binary serach skipped in case a download failed.