Xewdy444 / CF-Clearance-Scraper

A simple program for scraping Cloudflare clearance (cf_clearance) cookies from websites issuing Cloudflare challenges to visitors
MIT License
191 stars 31 forks source link

Failed to get cookies after using the proxy #12

Closed fomsun closed 1 year ago

fomsun commented 1 year ago

[14:22:08] [INFO] Launching headless browser... {'server': 'http//:xx.xx.xx.xx:8000:xx:xx'} [14:22:10] [INFO] Going to https://nowsecure.nl... [14:22:10] [ERROR] The operation couldn’t be completed. (kCFErrorDomainCFNetwork error 310.) =========================== logs =========================== navigating to "https://nowsecure.nl/", waiting until "load"

fomsun commented 1 year ago

If the UA and agent of the browser are added, they will flash back directly and prompt a message

[14:40:18] [INFO] Going to https://goerlifaucet.com/... [14:40:22] [ERROR] net::ERR_PROXY_CONNECTION_FAILED at https://goerlifaucet.com/ =========================== logs =========================== navigating to "https://goerlifaucet.com/", waiting until "load"

My UA information: Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.5112.101 Safari/537.36

Xewdy444 commented 1 year ago

If your proxy server requires authentication, then you should format the proxy URL like this:

protocol://username:password@host:port

fomsun commented 1 year ago

Thank you very much

fomsun commented 1 year ago

Man, I tried, but I can't. I suspect it's my proxy

[10:53:45] [INFO] Going to https://nowsecure.nl... [10:53:49] [ERROR] net::ERR_PROXY_CONNECTION_FAILED at https://nowsecure.nl/ =========================== logs =========================== navigating to "https://nowsecure.nl/", waiting until "load"

But you can give me your collection address (USDT). I'd like to contribute to the project (buy you a coffee hahh).

Xewdy444 commented 1 year ago

Yea, if the proxy URL is formatted correctly, then it is probably just a connection issue. Another thing to note is that the use of a Chrome user agent can cause difficulties with solving Cloudflare managed challenges. However, if it is a JavaScript challenge, there should not be a problem.

If you'd like to support me, here is my USDT address: G55msLeHLgX6ET1kJJCYJkSFPoiBGYb7dr9UVo4QvUN8

Any donation is very much appreciated!

fomsun commented 1 year ago

emmmm Do you have the eth network payment address? This is all I have

Xewdy444 commented 1 year ago

My ethereum address is 0xc6595803F7Dd4aF63B383b57a89c98A1F3B246B0