True nitter support - Githubissues

foobar546 commented 2 years ago

If you pass gallery-dl a nitter URL, it redirects to twitter. Why does it do that? It should download directly from the nitter instance and not do any twitter accesses.

jadedgnome commented 2 years ago

I think their should be an "option" to download from a nitter instance directly.

afterdelight commented 2 years ago

I agree

brsk93 commented 2 years ago

I agree as well. Personally, I use Nitter instances to get around NSFW content blocking. Not everyone wants to have a Twitter account, especially if they don't plan to use the site for anything other than scraping content. Being able to download directly from Nitter would also greatly benefit users' privacy without resorting to proxies or VPNs. You can never be too careful with today's social media hunger for users' data.

github-userx commented 2 years ago

Good point, agreed. I just used gallery-dl on a Twitter user but got numerous warnings that the nsfw photos require log-in. :-(

Hrxn commented 2 years ago

Simply get an account just for scraping, you don't have to give twitter your address or something...

rautamiekka commented 2 years ago

I did exactly that, and Twitter auto-banned me twice in a row right after logging in with gdl (TBF, I used a name like dummyacc), so had to contest the bans each time (I simply asked something simple like "why the ban ?"). At least they've left me alone ever since.

shinji257 commented 1 year ago

I'm going to request this as well and probably expand just a little bit.

When using a Nitter instance either use it as the primary source of images for a tweet or as a fallback (either works as long as it can grab it)
Allow a user to define a nitter instance base domain in the config for those not using the official domain. I built a copy with another nitter instance provided as an option and it was able to handle that as well but it can't grab age restricted tweets because gallery-dl goes through the twitter api to get everything anyways.

mikf commented 1 year ago

Commit https://github.com/mikf/gallery-dl/commit/6c153750fa9b787f0fd6ee59bd00f591e1520eca adds initial support for Nitter instances. Regular Tweets with images and videos work, but it might produce the wrong results for retweets/quotes and anything out of the ordinary.

It supports these six instances by default (should I add more?). It is possible to either prefix a URL with nitter: or add an entry to your config file to have gallery-dl recognize other instances.

        "nitter": {
            "twitter.censors.us": {"root": "https://twitter.censors.us"},
            "nitter.ca":          {"root": "https://nitter.ca"}
        }

jadedgnome commented 1 year ago

great! will it support filter flags as well?

please add this instance https://nitter.inpt.fr

consider these too.

``` https://bird.trom.tf https://birdsite.xanny.family https://canada.unofficialbird.com https://fuckthesacklers.network https://india.unofficialbird.com https://n.l5.ca https://n.ramle.be https://nederland.unofficialbird.com https://nitter.1d4.us https://nitter.at https://nitter.bird.froth.zone https://nitter.bus-hit.me https://nitter.ca https://nitter.caioalonso.com https://nitter.catalyst.sx https://nitter.cutelab.space https://nitter.cz https://nitter.d420.de https://nitter.dcs0.hu https://nitter.domain.glass https://nitter.drivet.xyz https://nitter.esmailelbob.xyz https://nitter.fdn.fr https://nitter.fly.dev https://nitter.foss.wtf https://nitter.fprivacy.com https://nitter.grimneko.de https://nitter.hu https://nitter.inpt.fr https://nitter.ir https://nitter.it https://nitter.kavin.rocks https://nitter.kylrth.com https://nitter.lacontrevoie.fr https://nitter.manasiwibi.com https://nitter.mint.lgbt https://nitter.moomoo.me https://nitter.namazso.eu https://nitter.net https://nitter.nicfab.eu https://nitter.nl https://nitter.poast.org https://nitter.priv.pw https://nitter.privacy.com.de https://nitter.privacydev.net https://nitter.privacytools.io https://nitter.projectsegfau.lt https://nitter.pussthecat.org https://nitter.pw https://nitter.qwik.space https://nitter.rawbit.ninja https://nitter.sethforprivacy.com https://nitter.slipfox.xyz https://nitter.smnz.de https://nitter.sneed.network https://nitter.soopy.moe https://nitter.spaceint.fr https://nitter.tiekoetter.com https://nitter.tokhmi.xyz https://nitter.twei.space https://nitter.unixfox.eu https://nitter.weiler.rocks https://nitter.winscloud.net https://nitter:nitter@nitter.nixnet.services https://nittereu.moomoo.me https://notabird.site https://nt.vern.cc https://ntr.odyssey346.dev https://nttr.stream ```

mikf / gallery-dl

True nitter support #2696