ghost
commented
4 years ago Hi @luizkc,
I'm sure we can figure this out. Would you mind sharing the debug output?
Redirect the stdout and stderr to a file or xclip and pastebin it:
node index.js > out.txt 2>&1
node index.js |& xclip -i -sel clipboardThe weirdest part about this is that my code works using the Python version of the module recreating the exact same requests.
Which python module? The same name python module is of plagiarism, license issues, has known vulnerabilities, spits in the face of FOSS, and is not to be trusted. It's a rip-off of the original cfscrape. Use cfscrape instead, it's maintained.
The challenge solving code in all of these libraries was written by me (including the plagiarized one) and they all generally work the same way if you're using equivalent options. The only exception being the redirect behavior. The python modules handle redirects in a non-standard way by always reusing the original request method instead of switching over to the GET method.
A very similar and recently solved issue: https://github.com/codemanki/cloudscraper/issues/255
When sending the post request, the console sometimes prints:
request received invalid jsonwhen debug is on.
When the json option is used, the request library's onRequestResponse handler attempts to parse the response as JSON. If you get e.g. HTML instead, it will intentionally fail silently unless, as you mentioned, debugging is enabled. The user should validate the response.body anyway since valid JSON once parsed could be a number, string, empty string, boolean, null, object, or an array. If you're expecting an array e.g.
const valid = Array.isArray(response.body) && response.body.length > 0;.
If you're trying to post JSON, try the json option instead of formData:
const gen = await cloudscraper.post({
url: "https://nakedcph.com/auth/submit",
resolveWithFullResponse: true,
followOriginalHttpMethod: true,
simple: false,
headers: headers,
json: {
_AntiCsrfToken: Csrf,
firstName: "CLOUDSCRAPER TEST",
email: "cloudscraper+123456@gmail.com",
password: "MyPassword123",
"g-recaptcha-response": String(captchaRes),
action: "register"
}
})Cheers
luizkc
JinSBU
Hi!
I'm using Cloudscraper version
4.14on Node version12.10.0.I'm attempting to access this website, which has a cloudflare protection page with a captcha.
I can bypass the cloudflare and access the site's homepage/any page, however, after bypassing, I am unable to successfully send a post request. The weirdest part about this is that my code works using the Python version of the module recreating the exact same requests.
When sending the post request, the console sometimes prints:
request received invalid jsonwhen debug is on.In my second request I need a csrf token that gets returned with the first request's (the bypass request) response. Essentially I am trying to create an account on this website by first retrieving the csrf after the initial bypass (which I can do successfully) and then sending a post request with the account information.
Like I said, I can do this successfully in Python which leads me to believe the issue is related to the module's way of handling post requests, but of course I'm probably wrong. This is my code when sending both requests.
I get a 200 on the first request, and a 403 on the 2nd. This is what the server returns on the 403:
{ Response: null, StatusCode: 500, Status: '' }Hopefully I'm being really stupid and there is a super simple solution to this. And like I said, my Python version is 100% functional doing the exact same request with the same headers and everything.
Thanks and sorry for any confusions and the long code. I've been looking at this for way longer than I should have and haven't been able to find the solution. Any help is much appreciated.