hack-ink / cloudflare-bypasser

A Rust crate to bypass Cloudflare's anti-bot page.

https://crates.io/crates/cloudflare-bypasser

MIT License

45 stars 9 forks source link

Unable to scrape a website #3

Open MGlolenstine opened 4 years ago

MGlolenstine commented 4 years ago

I'm unable to scrape one particular website, other sites work fine.

This website gets solved incorrectly.

They could be using a custom or at least slightly modified version of CF protection. Scraping other websites (https://kissanime.ru) works well, so I think that the problem is isolated to that one website.

HTML of protected site

here

TBye101 commented 3 years ago

I'd like to add to this that rent.com is not solved correctly either. Appears to be an issue in the parse_js function, the .captures(html) function is returning None for whatever reason...

AurevoirXavier commented 3 years ago

I'd like to add to this that rent.com is not solved correctly either. Appears to be an issue in the parse_js function, the .captures(html) function is returning None for whatever reason...

Okay, I'll take a look this weekend.

TBye101 commented 3 years ago

Appreciate it, thanks!