cant bypass this site - Githubissues

thanh858036 commented 2 years ago

it dont bybass cloadflare on this site https://bato.to/

error detail { "status": "ok", "message": "", "startTimestamp": 1626848183197, "endTimestamp": 1626848183575, "session": "d282ab10-e9ea-11eb-bea0-1b284ff0b0fb", "solution": { "url": "https://bato.to/", "status": 403, "headers": { "status": "403", "date": "Wed, 21 Jul 2021 06:16:23 GMT", "content-type": "text/plain; charset=UTF-8", "content-length": "16", "x-frame-options": "SAMEORIGIN", "cache-control": "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0", "expires": "Thu, 01 Jan 1970 00:00:01 GMT", "cf-request-id": "0b694e5c8200004ec7521f4000000001", "expect-ct": "max-age=604800, report-uri=\"https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct\"", "report-to": "{\"endpoints\":[{\"url\":\"https:\/\/a.nel.cloudflare.com\/report\/v3?s=uVAUOhtze1dS6YUzrURwYkkE%2Bwab6FEs%2FKD4JQaoHD8YyE8NyTDXzMi2RFPnQHG1wNW0A3MG78VJU02dPmfZob4NAJ9zVPHF2G9HdU1zFC6Zy0mo5GT8m4PmYWHWAQbLJwun9jw%3D\"}],\"group\":\"cf-nel\",\"max_age\":604800}", "nel": "{\"report_to\":\"cf-nel\",\"max_age\":604800}", "vary": "Accept-Encoding", "server": "cloudflare", "cf-ray": "67224cda6c454ec7-FRA", "alt-svc": "h3-27=\":443\"; ma=86400, h3-28=\":443\"; ma=86400, h3-29=\":443\"; ma=86400, h3=\":443\"; ma=86400" }, "response": "<html><head></head><body><pre style=\"word-wrap: break-word; white-space: pre-wrap;\">error code: 1005</pre></body></html>", "cookies": [], "userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.0 Safari/537.36" } } i tried { "cmd": "request.get", "url":"https://bato.to", "session":"d282ab10-e9ea-11eb-bea0-1b284ff0b0fb", "userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.0 Safari/537.36", "maxTimeout": 60000 }

Pyreaus commented 2 years ago

I'm getting a similar error - Idk if NoahCardoza is continuing work on this

serk7 commented 2 years ago

error code: 1005 <-- cloudflare error (Access Denied) "status": 403 <-- url status ( Forbidden)

Seems your ip is blacklisted on their site. Try using a proxy:

,"maxTimeout": 60000,"proxy":"proxy.xxxxxxxx.com:80"}"

NoahCardoza commented 2 years ago

@Pyreaus yeah, you are kinda right. I'd love to keep up my open source projects but unlike my job, they don't pay lol.

jairoxyz commented 2 years ago

I updated the stealth module ("puppeteer-extra-plugin-stealth": "^2.7.8") and am getting good response from bato.to:

2021-08-23T14:35:40.902Z INFO REQ-3 Incoming request: POST /v1
2021-08-23T14:35:40.903Z INFO REQ-3 Params: {"cmd":"request.get","session":"test","url":"https://bato.to/","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36","maxTimeout":10000}
2021-08-23T14:35:41.133Z DEBUG REQ-3 Using custom UA: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36
2021-08-23T14:35:41.134Z DEBUG REQ-3 Adding custom headers: {}
2021-08-23T14:35:41.134Z DEBUG REQ-3 { headers: [Function (anonymous)] }
2021-08-23T14:35:41.136Z DEBUG REQ-3 Navigating to... https://bato.to/
2021-08-23T14:35:41.138Z DEBUG REQ-3 {
  headers: {
    'upgrade-insecure-requests': '1',
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
  }
}
2021-08-23T14:35:43.094Z INFO REQ-3 Cloudflare detected
2021-08-23T14:35:43.333Z INFO REQ-3 Successful response in 2.431 s

I have a problem, though, updating the other puppeteer modules to the latest versions. Getting typescript errors when doing npm run build:

src/session.ts:101:7 - error TS2740: Type 'Browser' is missing the following properties from type 'Browser': setMaxListeners, getMaxListeners, listeners, rawListeners, and 3 more.

101       browser,
          ~~~~~~~

  src/session.ts:17:3
    17   browser: Browser
         ~~~~~~~
    The expected type comes from property 'browser' which is declared here on type 'SessionsCacheItem'

NoahCardoza / CloudProxy

cant bypass this site #54