search

TeamNewPipe / NewPipeExtractor

NewPipe's core library for extracting data from streaming sites
GNU General Public License v3.0
1.38k stars 417 forks source link

Add Invidious as an optional YouTube Source #427

Open Gymcap opened 6 years ago

Gymcap commented 6 years ago

Invidious is a clone of YouTube created for a similar reason to NewPipe. This site happens to use the exact same URL scheme as YouTube does, with pretty much the exact same layout, but with two major changes.

The only information that gets loaded on an Invidious page, is content and information about it. There is also slightly more information availible about the video loaded as well. I believe that invidious could be ported to NewPipe very quickly because of the way it is setup.

Here's an example video from Kurzgesagt - https://www.invidio.us/watch?v=-O5kNPlUV7w

As you can see, the layout is so minimalistic, that there is literally nothing to sift through in terms of porting. I really don't think it could be any easier site to port to NewPipe.

The main reason I bring this site up, is because if this site was added as an optional source for YouTube videos, then the user can effectively, disconnect from Google's YouTube entirely.

lionirdeadman commented 6 years ago

Backends are more than just scrapping the watching page, gotta also scrap the search page. (possibly even the main page although not sure)

Also, Invidio.us doesn't allow you to disconnect entirely, the video still comes from Youtube/Google.

But sure, we can use it for obfuscation of search results but it's ehh

omarroth commented 6 years ago

Invidious exposes an API that I imagine would be much easier to use than scraping the page.

@lionirdeadman is correct that videos still come from Google, although I expect them to be proxied with omarroth/invidious#34.

lionirdeadman commented 6 years ago

Neato. I wish you good luck though. Proxying Youtube videos for everyone sounds incredibly tough.

BlauerHunger commented 5 years ago

I'd like to see support for syncing subs with an invidious instance (public and custom)

Beapal commented 5 years ago

I often share video to social network and IM. It will be great to share with invidous url instead of youtube.

This can be at least optional with setting

poperigby commented 5 years ago

Maybe you could get it so you can log into your Invidious account to sync everything.

Psylocybine commented 5 years ago

Just like to add my voice to the mumble! This feat would be great, then I wouldn't have to figure out a way to let newpipe pass my google-filter in afwall:) I wish I'd have the skill to contribute!

beerisgood commented 5 years ago

How is the status?

Also Invidious provide a "&local=true" parameter which load the video completely from their own server, without any Google connections to Enduser

BeatLink commented 4 years ago

Any updates on this?

danialbehzadi commented 4 years ago

Still waiting for this…

ghost commented 4 years ago

@Stypox Would this not fix TeamNewPipe/NewPipe#3612? Also this would be awesome, maybe add it to v.0.20.0? I really want this now, after I turned off Tor for NewPipe, this would really be great for that new proxified solution :D

Also Invidious provide a "&local=true" parameter which load the video completely from their own server, without any Google connections to Enduser

B0pol commented 4 years ago

As it was already mentioned before in this thread, we won't scrape invidious but use their API. I don't know how to have invidious videos from their API, it's returning videos from googlevideos.com and i've tried local=true parameter, but it didn't work. One result seems to be proxied with invidious instance: dashUrl, but it may fall under https://github.com/TeamNewPipe/NewPipe/issues/2415 bug.

ghost commented 4 years ago

Alright @B0pol. Maybe skip the proxified parameters. But as TeamNewPipe/NewPipe#3710 mentioned and I did in #3612(Comment) wouldn't it solve reCAPTCHAs?

B0pol commented 4 years ago

I'd say yes, I haven't seen anything about rate limitation or captcha in api documentation. But I'm not sure.

Unless YouTube puts Captchas on ytimg.com (for thumbnails) and googlevideo.com (videos), but I doubt.

Megver83 commented 4 years ago

Alright @B0pol. Maybe skip the proxified parameters. But as TeamNewPipe/NewPipe#3710 mentioned and I did in TeamNewPipe/NewPipe#3612(Comment) wouldn't it solve reCAPTCHAs

I think this is one of the biggest reasons Invidious must be supported. YouTube just bothers too much with the CAPTCHAs when using VPN, in my case.

It would be nice to see a list of instances to select, like PeerTube, so that users can add their own instances

FYI, Straw-viewer (Invidious version of YouTube Viewer) uses the Invidious API and it hasn't give me any issues yet (like Google trying to block me)

alefvanoon commented 3 years ago

Any updates on this?

toniz4 commented 3 years ago

+1 on this. The invidious api is much more stable, will not break constantly like youtube does. Plus will not use google's servers directly for anyone who cares about this. Another plus is that they don't make you fill out a captcha time to time.

Joshndroid commented 3 years ago

I would like to see this utilised as well. Considering this is my go to for YouTube on Android I would like to hit my own local invidious self hosted instance

triallax commented 2 years ago

Quoting @SamantazFox from #789:

If anyone plan to work on that, it'd be preferrable to wait that we start working on an API v2 (or at least a remaster of the v1). Many things needs to be done on our side to ensure consistency across the API and make it more usable.

Also, it'd be awesome if we could have more instances hosting just the API, as the current official list is quite overloaded by bots scraping our API.

triallax commented 2 years ago

@trollogyadherent that's a separate request; this issue asks for fetching YouTube information from Invidious, not for sharing Invidious links. You're looking for https://github.com/TeamNewPipe/NewPipe/issues/2351.