search

Xerbo / furaffinity-dl

FurAffinity Downloader, now with 100% more Python
BSD 3-Clause "New" or "Revised" License
91 stars 17 forks source link

doesn't work through tor #8

Closed faustdotmef closed 4 years ago

faustdotmef commented 6 years ago

torify ./grab gallery/kacey ./cookies.txt --2018-03-23 15:03:24-- http://www.furaffinity.net/gallery/kacey Resolving www.furaffinity.net (www.furaffinity.net)... 104.20.69.59 Connecting to www.furaffinity.net (www.furaffinity.net)|104.20.69.59|:80... connected. HTTP request sent, awaiting response... 403 Forbidden 2018-03-23 15:03:24 ERROR 403: Forbidden.

same with https.

Shnatsel commented 6 years ago

Doesn't accessing it through Tor with web browser also produce 403?

If so, there's nothing we can do in the code to fix it.

faustdotmef commented 6 years ago

i tried to change user agent but it didn't help. i don't know what they check when see tor exit node which browser has and this script doesn't.

Helix-9 commented 6 years ago

They don't check for user agent, FurAffinity checks the exit's IP address and matches it with a database, if it matches (as it seems it did) it'll block you unless you score a exit node that isn't on the list, unfortunately this cannot be fixed nor improved by anyone (unless you can somehow specify witch exit node you want, but as i'm aware Tor doesn't let you do so)

swats-the-floran commented 6 years ago

well, after all i wrote my own grabber with python. works through tor well.

swats-the-floran commented 6 years ago

ah, and it doesn't need manual converting of cookies (which should be done on daily basis if you use tor).

Shnatsel commented 6 years ago

I wonder if it actually works reliably or you got lucky with an exit node that was not in the blacklist yet.

Anyway, if you've published the code, I'd be glad to link to it from furaffinity-dl readme. It's always nice to have alternatives.

swats-the-floran commented 6 years ago

yes, it's very stable. or course there are nodes blocked at furaffinity but fortunately not as many as about two years before.

code if published but not finished yet. it just downloads art from given gallery or submissions page. and you have to give it an initial setting by showing your mozilla directory with browser cookies. at first i want to make it work through clearnet and without cookies as well.

Xerbo commented 4 years ago

Due to the fact that this is furaffinity's backend blocking tor exit nodes and not the script I'm going to close this.