search

FriendsOfPHP / Goutte

Goutte, a simple PHP Web Scraper
MIT License
9.26k stars 1.01k forks source link

cloudflare bypass #343

Open barhom opened 6 years ago

barhom commented 6 years ago

anyone that have a cloudflare bypass for goutte? (its the annoying, javascript, wait 5 seconds)

dpde commented 6 years ago

Not possible with Goutte, since Goutte is just a HTTP client and does not interpret the response.

Maybe you can get around that page by using proxy servers?

barhom commented 6 years ago

Well is it possible for me to use guzzlehttp to fetch the HTML and then pass $res->getBody() to goute to interpret the HTML without letting goutte doing the request itself?

dpde commented 6 years ago

Sure you can get the html body, get data you need from it and then send another request.

But I can't tell you if this will be successful, because I don't know how the Cloudflare waiting page looks like.

Anan5a commented 6 years ago

Try this to bypass CF https://github.com/KyranRana/cloudflare-bypass

Denoder commented 6 years ago

but how do you use the cloudflare bypass, there's like no documentation @Anan5a