NotJoeMartinez / yt-fts

YouTube Full Text Search - Search all of a YouTube channel from the command line
The Unlicense
1.61k stars 81 forks source link

Getting "Sign in to confirm you’re not a bot. This helps protect our community." #166

Closed abdallahalsamman closed 2 months ago

abdallahalsamman commented 2 months ago
WARNING: [youtube] API returned broken formats (poToken experiment detected). Retrying (3/3)...
WARNING: [youtube] API returned broken formats (poToken experiment detected). Giving up after 3 retries
ERROR: [youtube] bDdGUFZg1YQ: Sign in to confirm you’re not a bot. This helps protect our community. Learn more
Failed to get: https://www.youtube.com/watch?v=bDdGUFZg1YQ
[0;31mERROR:[0m  bDdGUFZg1YQ: Sign in to confirm you’re not a bot. This helps protect our community. Learn more
WARNING: [youtube] Webpage contains broken formats (poToken experiment detected). Ignoring initial player response
WARNING: [youtube] API returned broken formats (poToken experiment detected). Retrying (1/3)...
WARNING: [youtube] API returned broken formats (poToken experiment detected). Retrying (2/3)...
WARNING: [youtube] API returned broken formats (poToken experiment detected). Retrying (3/3)...
WARNING: [youtube] API returned broken formats (poToken experiment detected). Giving up after 3 retries
ERROR: [youtube] eb9Q_Gz9hwM: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

Can you please allow us to add a cookie or something to solve this issue?

NotJoeMartinez commented 2 months ago

I've seen increasing reports of rate limiting errors and I'm working on a solution in https://github.com/NotJoeMartinez/yt-fts/issues/168. For now the best solution is to do the initial download then run the update command a couple times on the channel until you get all available videos into the database.

For example the initial transcript count of this channel was 386

yt-fts download -j 8 "https://www.youtube.com/@TwoMinutePapers"

After running update once it is 502

yt-fts update --number-of-jobs 8 -c 19

Edit: It's also a good idea to run script from different ips with a vpn

abdallahalsamman commented 2 months ago

@NotJoeMartinez alright got you, thank you so much!