AAndyProgram / SCrawler

🏳️‍🌈 Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.
https://discord.gg/uFNUXvFFmg
GNU General Public License v3.0
1.29k stars 85 forks source link

[BUG] RedGifs data is not downloading #69

Closed AAndyProgram closed 1 year ago

AAndyProgram commented 2 years ago

On August 31, RedGifs changed the API requirements. These changes cause an error on downloading. Unfortunately, at this time, I still cannot resolve this issue.

Starting from version 2022.9.8.0, downloading data from the RedGifs site is temporary disabled. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

If you know how to solve this issue, you can post a suggestion in a comment on this post.

AAndyProgram commented 2 years ago

Still nothing has changed. I tried downloading the HTML page and parsing it and it worked for a few minutes, but then they blocked my IP (I think) and I started getting the "Invalid signature" error again.

The-Morrighan commented 2 years ago

I've been trying to resolve this as well, mostly via ideas posted here: https://www.reddit.com/r/DataHoarder/comments/x67zfo/redgifs_api_now_blocked_from_hotlinking_anyone/ and here: https://github.com/RipMeApp/ripme/issues/1994#issuecomment-1235137334 and via their api page (all of which you've probably already seen, but I thought I'd share just in case) https://github.com/Redgifs/api/wiki/API-access

AAndyProgram commented 2 years ago

Already seen and follow. This doesn't work

AAndyProgram commented 2 years ago

Fixed. Please update to the latest release. If you like SCrawler, please like the program on this site: https://alternativeto.net/software/scrawler/about/.

Ihatetotank commented 2 years ago

Just tried to rip https://www.reddit.com/user/slaysheslays and it didn't capture any video from Redgifs

AAndyProgram commented 2 years ago

Read the guide and site requirements

AAndyProgram commented 2 years ago

It seems RedGifs has changed something again. Today I started getting a 401 (Unauthorized) error. I think authorization needs more than a bearer token and cookies.

FYI. Cookies are valid for a very short term. The bearer token refreshes every request. I think one bearer token could be valid for the duration of the cookies, but I'm not sure.

If you know how to solve this issue, you can post a suggestion in a comment on this post.

AAndyProgram commented 2 years ago

Hm... RedGifs seems to still work. RedGifs media posted on Reddit download without problems. The authorization error only occurs when loading a RedGifs profile. It can't get data for request https://api.redgifs.com/v2/users/UserName/search?order=recent

altbdoor commented 2 years ago

A plain curl seems to work fine. Maybe RedGifs were still experimenting stuff on their servers?

$ curl 'https://api.redgifs.com/v2/users/celebs/search?order=recent'
{"page":1,"pages":12,"total":341,"gifs":[{"id":"oblongclosesiskin","createDate":1651916881, #snib
AAndyProgram commented 2 years ago

You are right! It doesn't require cookies and token! Just a simple request without authorization! Brilliant! Thank you! Actually, I didn't even think about the test without credentials!

AAndyProgram commented 2 years ago

Fixed. Please update to the latest release. If you like SCrawler, please like the program on this site: https://alternativeto.net/software/scrawler/about/.


Get RedGifs temporary token

GET /v2/auth/temporary HTTP/1.1
Host: api.redgifs.com
Accept: application/json

{
 "token":"...",
 "addr":"2a00::579f:3c01:b94e",
 "agent":"curl/7.81.0",
 "rtfm":"https://github.com/Redgifs/api/wiki/API-access"
}

Get specific post data (token required): https://api.redgifs.com/v2/gifs/<PostID>?views=yes&users=yes Get a list of the user's posts (nothing required): https://api.redgifs.com/v2/users/<UserID>/search?order=recent

Ihatetotank commented 1 year ago

Dang, did it break again?

AAndyProgram commented 1 year ago

Yes

AAndyProgram commented 1 year ago

Fixed... Again... 😕 Please update to the latest release. 🎄 Happy new year! 🎄