Closed RealistikDash closed 3 years ago
The 2nd option might be better, since it will also allow for unscouted songs.
On Wed, Aug 25, 2021 at 10:44 AM RealistikDash @.***> wrote:
Currently, attempting to crawl a song from the official GD servers using Rob's client endpoint triggers the newly implemented Cloudflare firewall, resulting in the error 1020.
There are 2 ways to approach this:
- Attempt to bypass Rob's firewall by mirroring a request made by GD as closely as possible (may include mirroring headers + post data)
- Bypass GD servers completely and crawl from Newgrounds (will also allow to bypass unscouted songs).
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/RealistikDash/GDPyS/issues/88, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHKITZRX42XR267LSCT5CPDT6T6VLANCNFSM5CZHVTQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .
Issue solved with latest commit (667e360), using Newgrounds directly (also allows us to use unscouted songs)!
Currently, attempting to crawl a song from the official GD servers using Rob's client endpoint triggers the newly implemented Cloudflare firewall, resulting in the error 1020.
There are 2 ways to approach this: