carlosflorencio / laracasts-downloader

Downloads new lessons and series from laracasts if there are updates. Or the whole catalogue.
http://carlosflorencio.github.io/laracasts-downloader
MIT License
686 stars 146 forks source link

ERROR: Client error response [url] https://laracasts.com [status code] 403 [reason phrase] Forbidden #154

Open Sotiris-k opened 4 months ago

Sotiris-k commented 4 months ago

Hello,

Firstly thank you for this great tool, it's been really helpful for me to be able to watch laracasts videos offline and through my home media server.

Now to the issue at hand, today when I tried to do the daily check for any new videos I got the topic's error message.

ERROR: Client error response [url] https://laracasts.com [status code] 403 [reason phrase] Forbidden

Any thoughts?

arjendevos commented 3 months ago

This entire repo isn't working anymore. You can fix this error by adding an User-Agent to the headers and changing content-type to Content-Type & accept to Accept.

However downloading with vimeo won't work

carlosflorencio commented 3 months ago

@Sotiris-k can you test if this fixes the issue? https://github.com/carlosflorencio/laracasts-downloader/pull/155

Thanks @arjendevos

Sotiris-k commented 3 months ago

I've changed the occurrences of what @arjendevos mentioned in Http/Resolver.php but it didn't fix anything unfortunately.

arjendevos commented 3 months ago

@Sotiris-k did you install Proxyman?

Sotiris-k commented 3 months ago

I just noticed your PR @arjendevos . Made all the other changes you did in that PR but I didn't use Proxyman. I guess it must be a requisite.

arjendevos commented 3 months ago

@Sotiris-k weird workaround I know but it works (you need to enable SSL on laracast.com and player.vimeo.com in proxyman)

Sotiris-k commented 3 months ago

I don't think I can use Proxyman since I'm not on iOS and I'm running this utility through WSL

nlmenke commented 3 months ago

Some of us run this on headless servers (and/or on a cron schedule). If it can't be included in the docker image, a 3rd-party app requirement isn't an acceptable answer.

arjendevos commented 3 months ago

@nlmenke this isn't really a solution just a patch. The issue lies in the ssl certificates. You are free to fix the issue if you understand it

nlmenke commented 3 months ago

Looks like the issue (at least for the Laracasts side) is with Cloudflare's anti-bot system, so I guess the goal is to bypass that.

AmirRezaM75 commented 1 month ago

Does the issue still exist? I've just removed my cache file and start the script. Both "scrapping" and "downloading" functionalities work fine. (tested without subscription)

nlmenke commented 1 month ago

I just reran it locally (fresh repo, no changes) and everything works fine for me as well. I wonder if they just loosened the security on Cloudflare, but running this through both docker compose ... and docker run ... seem to be working as expected now.

Sotiris-k commented 1 month ago

Unfortunately for me the issue persists. Cache or no cache, same thing.