[Idea/feature to implement] Captcha is bypassed with embedded youtube urls

CactiChameleon9 commented 3 years ago

Checklist

[x] I checked, but didn't find any duplicates (open OR closed) of this issue in the repo.
[x] I have read the contribution guidelines given at https://github.com/TeamNewPipe/NewPipe/blob/HEAD/.github/CONTRIBUTING.md.
[x] This issue contains only one feature request. I will open one issue for every feature I want to request.

Describe the feature you want

A friend pointed out to me that embedded YouTube videos don't get captcha, I recently tested this and found it to be true!! (see below) I think that an embedded link should be used as a fallback if captcha is requested (if possible) or entierly instead of the standard links (2nd option may not good for anonymity, not too sure)

Is your feature request related to a problem? Please describe it

Kinda. It is trying to fix the captcha requirements while on tor or a VPN. It could be related to the proposed change to a tor useragent

Additional context

Here was my testing: Using a vpn, I tried to watch a video and I get a captcha, so I copied the requested URL (https://m.youtube.com/watch?v=enBjzAhNHm8) from the captcha page to my browser and tried to open it, which resulted to the same captcha page. If I change the URL to an embedded link (https://m.youtube.com/embed/watch?v=enBjzAhNHm8) it allows me to the normal YouTube page, without the captcha. Returning it to normal still requires the captcha. (Probably more vigorous testing needed)

How will you/everyone benefit from this feature?

This would mean that captchas could be bypassed when using newpipe, reducing fingerprinting from the webview instance and captcha webpage that is opened and allowing for a more seamless experience over tor and some VPNs

arihan-1560795 commented 3 years ago

I've been getting captchas on both of my phones regardless of whether I'm connected to a VPN or not- across various networks (different buildings). This would be a godsent if I don't have to spend 2-3 minutes doing those puzzles.

ghost commented 3 years ago

@CactiChameleon9 Quite a marvelous finding, this could really mean using YouTube anonymously using orbot as you won't get annoying captchas

CactiChameleon9 commented 3 years ago

@hefty-fading-culprit-epiphany-drew It wasn't me who found it, a friend found it - I will ask if he wants credit here. I really hope this gets implemented, it would be so great!

MD77MD commented 3 years ago

I really hope so

@hefty-fading-culprit-epiphany-drew It wasn't me who found it, a friend found it - I will ask if he wants credit here. I really hope this gets implemented, it would be so great!

samuraikid0 commented 3 years ago

And the captcha fails more than i QQ this is just a privacy blocker scheme hope we find a solution keep it up

FireMasterK commented 3 years ago

Can you confirm whether the desktop variant works? Eg: https://www.youtube.com/embed/enBjzAhNHm8

CactiChameleon9 commented 3 years ago

@FireMasterK I just tested... And yes it works! However the mobile version may be more useful, due to the comments still being there (identical to normal mobile web page). I am unsure of the restrictions to the extractor with mobile and normal embedded links though - I am sure you and the other devs do (or can find out)

nadiration commented 3 years ago

I think this needs to be implemented asap, this captcha shit is happening multiple times a day and is making the app unusable. @CactiChameleon9 thank you for this. This captcha is annoying as hell

FireMasterK commented 3 years ago

I created an issue in NPE with some technical details for anyone who wants to implement it. (Linked above)

infinitewaveparticle commented 3 years ago

This sounds like a great idea. I wonder how long til youtube starts requiring captchas on embedded videos. They seem to ruin everything.

nadiration commented 3 years ago

This needs to be implemented as it's our last hope

FireMasterK commented 3 years ago

Embedded videos do not work with music videos.

Needless to say, the ProtoBuf Mobile API would be a better alternative imo since it gives more information and is not rate-limited either.

CactiChameleon9 commented 3 years ago

https://github.com/TeamNewPipe/NewPipeExtractor/issues/562 has been closed now, so is this implementable yet? (note: I am no longer suffering issues under vpn, but I am sure it will help with tor users or people with flagged ips from their ISPs)

FireMasterK commented 3 years ago

https://github.com/TeamNewPipe/NewPipeExtractor/issues/562 has been closed now, so is this implementable yet? (note: I am no longer suffering issues under vpn, but I am sure it will help with tor users or people with flagged ips from their ISPs)

It's closed because it's been implemented already.

TeamNewPipe / NewPipe