search

FlareSolverr / FlareSolverr

Proxy server to bypass Cloudflare protection
MIT License
7.88k stars 669 forks source link

New FlareSolverr 3.0.0.beta #522

Closed ngosang closed 1 year ago

ngosang commented 2 years ago

I'm developing a new version of FlareSolverr from scratch using different technologies.

For now it's in beta state and it lacks some features:

It's compatible with FlareSolverr 2.x so you can interchange the Docker images. If you find any problem, please report in this issue. @ilike2burnthing would you like to test it?

Docker image: ngosang/flaresolverr:3.0.0.beta3 Source code: https://github.com/FlareSolverr/FlareSolverr/tree/v3beta

ilike2burnthing commented 2 years ago

Will test now on Windows.

ilike2burnthing commented 2 years ago

Built from source and installed Chrome as per readme - https://github.com/FlareSolverr/FlareSolverr/tree/feature/v3#from-source-code

While FlareSolverr is able to solve challenges, it's opening a Chrome browser window to do so.

Only other potential issue I've seen is that the ReqIds appear to be random, whereas previously they were sequential. Not sure if this was purposeful.

ilike2burnthing commented 2 years ago

acgsou in Jackett v2.2.8 - https://github.com/FlareSolverr/FlareSolverr/issues/523 v3.0.0.beta1 - working

ngosang commented 2 years ago

New beta version with many fixes. Docker image: ngosang/flaresolverr:3.0.0.beta2 Source code: https://github.com/FlareSolverr/FlareSolverr/tree/v3beta

ilike2burnthing commented 2 years ago

Looks good, everything seems to be working well.

I came across an issue that exists in v3, as well as v2.2.9/8, that a Cloudflare Error 522: Connection timed out page results in invalid cookies for Jackett. In v3 FlareSolverr is saying challenge not detected, whereas v2.2.9/8 is saying it's detected and solved.

2022-09-25 15:30:10 INFO     ReqId 6476 Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://sound-park.world/filter/?sort_method=1&sorting_type=undefined&genres=&qualities=&country_keyword=&countries=&releases=&start_year=&end_year=&search_keyword='}
2022-09-25 15:30:10 DEBUG    ReqId 6476 Launching web browser...
2022-09-25 15:30:10 DEBUG    ReqId 1344 Navigating to... https://sound-park.world/filter/?sort_method=1&sorting_type=undefined&genres=&qualities=&country_keyword=&countries=&releases=&start_year=&end_year=&search_keyword=
2022-09-25 15:30:44 INFO     ReqId 1344 Challenge not detected!
2022-09-25 15:30:44 DEBUG    ReqId 6476 Response => POST /v1 body: {'status': 'ok', 'message': 'Challenge not detected!', 'solution': {'url': 'https://sound-park.world/filter/?sort_method=1&sorting_type=undefined&genres=&qualities=&country_keyword=&countries=&releases=&start_year=&end_year=&search_keyword=', 'status': 200, 'cookies': [{'domain': 'sound-park.world', 'expiry': 1664116274, 'httpOnly': False, 'name': 'cf_use_ob', 'path': '/', 'secure': False, 'value': '0'}, {'domain': 'sound-park.world', 'expiry': 1664119813, 'httpOnly': False, 'name': 'cf_chl_prog', 'path': '/', 'secure': False, 'value': 'x14'}, {'domain': 'sound-park.world', 'expiry': 1664119811, 'httpOnly': False, 'name': 'cf_chl_2', 'path': '/', 'secure': False, 'value': '0ff1a1dd8a83579'}], 'headers': {}, 'response': '<html class="no-js" lang="en-US"><!--<![endif]--><head>\n\n\n<title>sound-park.world | 522: Connection timed out</title>\n<meta charset="UTF-8">\n<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">\n<meta http-equiv="X-UA-Compatible" content="IE=Edge">\n<meta name="robots" content="noindex, nofollow">\n<meta name="viewport" content="width=device-width,initial-scale=1">\n<link rel="stylesheet" id="cf_styles-css" href="/cdn-cgi/styles/main.css">\n\n\n</head>\n<body>\n<div id="cf-wrapper">\n\n    \n\n    <div id="cf-error-details" class="p-0">\n        <header class="mx-auto pt-10 lg:pt-6 lg:px-8 w-240 lg:w-full mb-8">\n            <h1 class="inline-block sm:block sm:mb-2 font-light text-60 lg:text-4xl text-black-dark leading-tight mr-2">\n              \n              <span class="inline-block">Connection timed out</span>\n              <span class="code-label">Error code 522</span>\n            </h1>\n            <div>\n               Visit <a href="https://www.cloudflare.com/5xx-error-landing?utm_source=errorcode_522&amp;utm_campaign=sound-park.world" target="_blank" rel="noopener noreferrer">cloudflare.com</a> for more information.\n            </div>\n            <div class="mt-3">2022-09-25 14:30:44 UTC</div>\n        </header>\n        \n        <div class="my-8 bg-gradient-gray">\n            <div class="w-240 lg:w-full mx-auto">\n                <div class="clearfix md:px-8">\n                  \n<div id="cf-browser-status" class=" relative w-1/3 md:w-full py-15 md:p-0 md:py-8 md:text-left md:border-solid md:border-0 md:border-b md:border-gray-400 overflow-hidden float-left md:float-none text-center">\n  <div class="relative mb-10 md:m-0">\n    \n    <span class="cf-icon-browser block md:hidden h-20 bg-center bg-no-repeat"></span>\n    <span class="cf-icon-ok w-12 h-12 absolute left-1/2 md:left-auto md:right-0 md:top-0 -ml-6 -bottom-4"></span>\n    \n  </div>\n  <span class="md:block w-full truncate">You</span>\n  <h3 class="md:inline-block mt-3 md:mt-0 text-2xl text-gray-600 font-light leading-1.3">\n    \n    Browser\n    \n  </h3>\n  <span class="leading-1.3 text-2xl text-green-success">Working</span>\n</div>\n\n<div id="cf-cloudflare-status" class=" relative w-1/3 md:w-full py-15 md:p-0 md:py-8 md:text-left md:border-solid md:border-0 md:border-b md:border-gray-400 overflow-hidden float-left md:float-none text-center">\n  <div class="relative mb-10 md:m-0">\n    <a href="https://www.cloudflare.com/5xx-error-landing?utm_source=errorcode_522&amp;utm_campaign=sound-park.world" target="_blank" rel="noopener noreferrer">\n    <span class="cf-icon-cloud block md:hidden h-20 bg-center bg-no-repeat"></span>\n    <span class="cf-icon-ok w-12 h-12 absolute left-1/2 md:left-auto md:right-0 md:top-0 -ml-6 -bottom-4"></span>\n    </a>\n  </div>\n  <span class="md:block w-full truncate">Manchester</span>\n  <h3 class="md:inline-block mt-3 md:mt-0 text-2xl text-gray-600 font-light leading-1.3">\n    <a href="https://www.cloudflare.com/5xx-error-landing?utm_source=errorcode_522&amp;utm_campaign=sound-park.world" target="_blank" rel="noopener noreferrer">\n    Cloudflare\n    </a>\n  </h3>\n  <span class="leading-1.3 text-2xl text-green-success">Working</span>\n</div>\n\n<div id="cf-host-status" class="cf-error-source relative w-1/3 md:w-full py-15 md:p-0 md:py-8 md:text-left md:border-solid md:border-0 md:border-b md:border-gray-400 overflow-hidden float-left md:float-none text-center">\n  <div class="relative mb-10 md:m-0">\n    \n    <span class="cf-icon-server block md:hidden h-20 bg-center bg-no-repeat"></span>\n    <span class="cf-icon-error w-12 h-12 absolute left-1/2 md:left-auto md:right-0 md:top-0 -ml-6 -bottom-4"></span>\n    \n  </div>\n  <span class="md:block w-full truncate">sound-park.world</span>\n  <h3 class="md:inline-block mt-3 md:mt-0 text-2xl text-gray-600 font-light leading-1.3">\n    \n    Host\n    \n  </h3>\n  <span class="leading-1.3 text-2xl text-red-error">Error</span>\n</div>\n\n                </div>\n              \n            </div>\n        </div>\n\n        <div class="w-240 lg:w-full mx-auto mb-8 lg:px-8">\n            <div class="clearfix">\n                <div class="w-1/2 md:w-full float-left pr-6 md:pb-10 md:pr-0 leading-relaxed">\n                    <h2 class="text-3xl font-normal leading-1.3 mb-4">What happened?</h2>\n                    <p>The initial connection between Cloudflare\'s network and the origin web server timed out. As a result, the web page can not be displayed.</p>\n                </div>\n              \n                <div class="w-1/2 md:w-full float-left leading-relaxed">\n                    <h2 class="text-3xl font-normal leading-1.3 mb-4">What can I do?</h2>\n                          <h3 class="text-15 font-semibold mb-2">If you\'re a visitor of this website:</h3>\n      <p class="mb-6">Please try again in a few minutes.</p>\n\n      <h3 class="text-15 font-semibold mb-2">If you\'re the owner of this website:</h3>\n      <p><span>Contact your hosting provider letting them know your web server is not completing requests. An Error 522 means that the request was able to connect to your web server, but that the request didn\'t finish. The most likely cause is that something on your server is hogging resources.</span> <a rel="noopener noreferrer" href="https://support.cloudflare.com/hc/en-us/articles/200171906-Error-522">Additional troubleshooting information here.</a></p>\n                </div>\n            </div>\n              \n        </div>\n\n        <div class="cf-error-footer cf-wrapper w-240 lg:w-full py-10 sm:py-4 sm:px-8 mx-auto text-center sm:text-left border-solid border-0 border-t border-gray-300">\n  <p class="text-13">\n    <span class="cf-footer-item sm:block sm:mb-1">Cloudflare Ray ID: <strong class="font-semibold">750474e1784454c3</strong></span>\n    <span class="cf-footer-separator sm:hidden">•</span>\n    <span id="cf-footer-item-ip" class="cf-footer-item sm:block sm:mb-1">\n      Your IP:\n      <button type="button" id="cf-footer-ip-reveal" class="cf-footer-ip-reveal-btn">Click to reveal</button>\n      <span class="hidden" id="cf-footer-ip">86.14.127.127</span>\n      <span class="cf-footer-separator sm:hidden">•</span>\n    </span>\n    <span class="cf-footer-item sm:block sm:mb-1"><span>Performance &amp; security by</span> <a rel="noopener noreferrer" href="https://www.cloudflare.com/5xx-error-landing?utm_source=errorcode_522&amp;utm_campaign=sound-park.world" id="brand_link" target="_blank">Cloudflare</a></span>\n    \n  </p>\n  <script>(function(){function d(){var b=a.getElementById("cf-footer-item-ip"),c=a.getElementById("cf-footer-ip-reveal");b&&"classList"in b&&(b.classList.remove("hidden"),c.addEventListener("click",function(){c.classList.add("hidden");a.getElementById("cf-footer-ip").classList.remove("hidden")}))}var a=document;document.addEventListener&&a.addEventListener("DOMContentLoaded",d)})();</script>\n</div><!-- /.error-footer -->\n\n\n    </div>\n</div>\n\n\n\n</body></html>', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36'}, 'startTimestamp': 1664116210315, 'endTimestamp': 1664116244652, 'version': '3.0.0.beta2'}
2022-09-25 15:30:44 INFO     ReqId 6476 Response in 34.337 s
2022-09-25 15:30:44 INFO     ReqId 6476 127.0.0.1 POST http://127.0.0.1:8191/v1 200 OK
ilike2burnthing commented 2 years ago

Separate issue.

BiTTurk eventually times out on v3, doesn't matter if I use a timeout of 55s or 550s.:

2022-09-25 16:27:30 INFO     ReqId 5144 Incoming request => POST /v1 body: {'maxTimeout': 155000, 'cmd': 'request.get', 'url': 'http://bitturk.net/?p=torrents&pid=32&keywords=&search_type=name&searchin=title&sortOptions[sortBy]=added&sortOptions[sortOrder]=desc'}
2022-09-25 16:27:30 DEBUG    ReqId 5144 Launching web browser...
2022-09-25 16:27:31 DEBUG    ReqId 1524 Navigating to... http://bitturk.net/?p=torrents&pid=32&keywords=&search_type=name&searchin=title&sortOptions[sortBy]=added&sortOptions[sortOrder]=desc
2022-09-25 16:27:32 INFO     ReqId 1524 Challenge detected. Selector found: #trk_jschal_js
2022-09-25 16:27:32 DEBUG    ReqId 1524 Waiting for selector: #cf-challenge-running
2022-09-25 16:27:32 DEBUG    ReqId 1524 Waiting for selector: .ray_id
2022-09-25 16:27:32 DEBUG    ReqId 1524 Waiting for selector: .attack-box
2022-09-25 16:27:32 DEBUG    ReqId 1524 Waiting for selector: #cf-please-wait
2022-09-25 16:27:32 DEBUG    ReqId 1524 Waiting for selector: #trk_jschal_js
2022-09-25 16:27:37 DEBUG    ReqId 1524 Timeout waiting for selector

[... repeats ...]

2022-09-25 16:29:50 DEBUG    ReqId 1524 Waiting for selector: #cf-challenge-running
2022-09-25 16:29:50 DEBUG    ReqId 1524 Waiting for selector: .ray_id
2022-09-25 16:29:50 DEBUG    ReqId 1524 Waiting for selector: .attack-box
2022-09-25 16:29:50 DEBUG    ReqId 1524 Waiting for selector: #cf-please-wait
2022-09-25 16:29:50 DEBUG    ReqId 1524 Waiting for selector: #trk_jschal_js
2022-09-25 16:29:55 DEBUG    ReqId 1524 Timeout waiting for selector
2022-09-25 16:30:06 ERROR    ReqId 5144 Error: Error solving the challenge. Timeout after 155.0 seconds.
2022-09-25 16:30:16 DEBUG    ReqId 5144 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 155.0 seconds.', 'startTimestamp': 1664119650588, 'endTimestamp': 1664119816677, 'version': '3.0.0.beta2'}
2022-09-25 16:30:16 INFO     ReqId 5144 Response in 166.089 s
2022-09-25 16:30:16 INFO     ReqId 5144 127.0.0.1 POST http://127.0.0.1:8191/v1 500 Internal Server Error

Whereas v2.2.9 is successful:

2022-09-25T15:36:37+00:00 INFO REQ-2 Incoming request => POST /v1 body: {"maxTimeout":90000,"cmd":"request.get","url":"http://bitturk.net/?p=torrents&pid=32&keywords=&search_type=name&searchin=title&sortOptions[sortBy]=added&sortOptions[sortOrder]=desc"}
2022-09-25T15:36:47+00:00 INFO REQ-2 Cloudflare detected
2022-09-25T15:36:57+00:00 INFO REQ-2 Challenge solved
2022-09-25T15:37:00+00:00 INFO REQ-2 Response in 22.894 s
2022-09-25T15:37:00+00:00 INFO REQ-3 Incoming request => POST /v1 body: {"maxTimeout":90000,"cmd":"request.get","url":"http://bitturk.net/?p=home&pid=1"}
2022-09-25T15:37:09+00:00 INFO REQ-3 Cloudflare detected
2022-09-25T15:37:21+00:00 INFO REQ-3 Challenge solved
2022-09-25T15:37:24+00:00 INFO REQ-3 Response in 23.583 s
Hyperz commented 2 years ago

Since it's Chrome-based now does that mean SOCKS support isn't coming back in the future? IIRC Chrome doesn't support those which is very limiting IMO.

KyleSanderson commented 2 years ago

2022-10-10 02:39:45 INFO Incoming request => POST /v1 body: {'maxTimeout': 165000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login'} 2022-10-10 02:39:57 INFO Challenge detected. Selector found: #trk_jschal_js 2022-10-10 02:42:36 ERROR Error: Error solving the challenge. Timeout after 165.0 seconds. 2022-10-10 02:42:36 INFO Response in 170.554 s 2022-10-10 02:42:36 INFO 10.42.0.156 POST http://flaresolverr.flaresolverr:8191/v1 500 Internal Server Error

buginot commented 2 years ago

If you work in 20 threads, then after an hour the processor is already 100% clogged and everything hangs. Occurs due to answers - "just a moment"

buginot commented 2 years ago

This never happened with version 2.2. 9

basudip commented 2 years ago

Beta 2 running fine for last two weeks. Everything working good. Even famous 1337x cookie error is gone. Any ETA on V3 stable build? Beta 2 is very stable at the moment. 👍

ecchirealm commented 2 years ago

Cloudflare added a security protocol that detects headless browsers, anyway to bypass this?

Zeks commented 2 years ago

I don't think docker beta works properly:

2022-10-20 00:47:42 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://m.fanfiction.net/u/7451371/?a=fs', 'maxTimeout': 80000}
2022-10-20 00:47:44 INFO     Challenge detected. Selector found: #trk_jschal_js
2022-10-20 00:49:03 ERROR    Error: Error solving the challenge. Timeout after 80.0 seconds.
2022-10-20 00:49:03 INFO     Response in 80.75 s
buginot commented 2 years ago

It also started today 2022-10-20 15:57:04 INFO Challenge detected. Selector found: #trk_jschal_js 2022-10-20 15:58:44 ERROR Error: Error solving the challenge. Timeout after 100.0 seconds. 2022-10-20 15:58:44 INFO Response in 100.956 s

Dylqn commented 2 years ago

beta2 resolved this issue for me. Thank you!

2022-10-20` 09:01:23 INFO    FlareSolverr 3.0.0.beta2
2022-10-20 09:01:23 INFO     Testing web browser installation...
2022-10-20 09:01:31 INFO     FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.114 Safari/537.36
2022-10-20 09:01:31 INFO     Test successful
2022-10-20 09:01:31 INFO     Serving on http://0.0.0.0:8191
2022-10-20 09:01:46 INFO     172.17.0.1 GET http://172.3.0.7:8191/ 200 OK
2022-10-20 09:01:57 INFO     Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': '#note-I-removed-the-URL-from-this-line}'}
2022-10-20 09:01:59 INFO     Challenge detected. Selector found: #trk_jschal_js
2022-10-20 09:02:03 INFO     Challenge solved!
2022-10-20 09:02:03 INFO     Response in 6.219 s
2022-10-20 09:02:03 INFO     172.17.0.1 POST http://172.3.0.1:8191/v1 200 OK
ngosang commented 2 years ago

Since it's Chrome-based now does that mean SOCKS support isn't coming back in the future?

I think it's possible with an add-on.

Cloudflare added a security protocol that detects headless browsers, anyway to bypass this?

FlareSolverr v3 uses head-full mode hence it's undetected.

https://hd-space.org/index.php?page=login%27%7D

Not fixed.

https://m.fanfiction.net/u/7451371/?a=fs

Fixed.

New beta3 Docker image: ngosang/flaresolverr:3.0.0.beta3 Source code: https://github.com/FlareSolverr/FlareSolverr/tree/v3beta

Zeks commented 2 years ago

https://m.fanfiction.net/u/7451371/?a=fs is not fixed at all, I checked with beta 3:

2022-10-20 20:00:35 WARNING  Request parameter 'headers' was removed in FlareSolverr v2.
2022-10-20 20:00:35 WARNING  Request parameter 'userAgent' was removed in FlareSolverr v2.
2022-10-20 20:00:36 INFO     Challenge detected. Selector found: #trk_jschal_js
2022-10-20 20:01:56 ERROR    Error: Error solving the challenge. Timeout after 80.0 seconds.
2022-10-20 20:01:56 INFO     Response in 80.751 s
2022-10-20 20:01:56 INFO     172.17.0.1 POST http://localhost:17860/v1 500 Internal Server Error
2022-10-20 20:02:28 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://m.fanfiction.net/u/7451371/?a=fs', 'maxTimeout': 80000}
2022-10-20 20:02:29 INFO     Challenge detected. Selector found: #trk_jschal_js
2022-10-20 20:03:49 ERROR    Error: Error solving the challenge. Timeout after 80.0 seconds.
2022-10-20 20:03:49 INFO     Response in 80.783 s
2022-10-20 20:03:49 INFO     172.17.0.1 POST http://localhost:17860/v1 500 Internal Server Error
xJayson commented 2 years ago

Waiting for beta4.

Hopefully it fixes the current issues.

Tutunova commented 2 years ago

I'm getting this issue image

7161457 commented 2 years ago

Hello, I am using FlareSolver of V3beta2. In my use, I can pass through the cloudflare shield normally, but the cookies are all failed. I will jump to the page where I did not log in, and let me enter my account password to log in. My cookies are extracted through Google Chrome, which is the cookies extracted by this browser.

Screenshots ![1](https://user-images.githubusercontent.com/113887555/199206549-f18a10a0-eb57-4a22-8c1b-b75eba7346cd.jpg) ![2](https://user-images.githubusercontent.com/113887555/199206570-70bacf47-0d4a-4edb-9c51-8647a92d2ce1.jpg) ![3](https://user-images.githubusercontent.com/113887555/199206596-467edf30-2df7-436e-9f7a-4eba6151b114.jpg) ![4](https://user-images.githubusercontent.com/113887555/199206620-1b54efc4-b7b7-48fc-89df-1585d2c4cdf0.jpg) ![5](https://user-images.githubusercontent.com/113887555/199206651-c14f9105-1e71-42c3-b07b-c6c60e5e6fa3.jpg) ![6](https://user-images.githubusercontent.com/113887555/199206681-e6125891-7aaf-4f6b-b498-bf1bc90adf11.jpg) ![7](https://user-images.githubusercontent.com/113887555/199206705-47ce27c7-2fbd-4789-8773-42cc4d4531de.jpg)
Zeks commented 2 years ago

is fanfiction.net fix even expected at all?

ilike2burnthing commented 2 years ago

When the dev or another contributor has time. PRs are always welcome.

marujun commented 2 years ago

Use 3.0.0.beta3 Error

curl -L -X POST 'http://127.0.0.1:8191/v1' \
-H 'Content-Type: application/json' \
--data-raw '{
  "cmd": "request.get",
  "url":"https://kp.m-team.cc/login.php",
  "maxTimeout": 60000
}'

log info

L2022-11-12 08:35:52 INFO     ReqId 139696550188864 FlareSolverr 3.0.0.beta3
E2022-11-12 08:35:52 DEBUG    ReqId 139696550188864 Debug log enabled
W2022-11-12 08:35:52 INFO     ReqId 139696550188864 Testing web browser installation...
L2022-11-12 08:35:52 DEBUG    ReqId 139696550188864 Launching web browser...
�2022-11-12 08:35:53 INFO     ReqId 139696550188864 FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36
C2022-11-12 08:35:53 INFO     ReqId 139696550188864 Test successful
R2022-11-12 08:35:53 INFO     ReqId 139696550188864 Serving on http://0.0.0.0:8191
�2022-11-12 08:36:50 INFO     ReqId 139696520779520 Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://kp.m-team.cc/login.php', 'maxTimeout': 60000}
L2022-11-12 08:36:50 DEBUG    ReqId 139696520779520 Launching web browser...
c2022-11-12 08:36:51 DEBUG    ReqId 139696411760384 Navigating to... https://kp.m-team.cc/login.php
B2022-11-12 08:36:52 DEBUG    ReqId 139696411760384 Response HTML:
<html lang="en-US"><head>
$    <title>Just a moment...</title>
H    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
:    <meta http-equiv="X-UA-Compatible" content="IE=Edge">
4    <meta name="robots" content="noindex,nofollow">
H    <meta name="viewport" content="width=device-width,initial-scale=1">
B    <link href="/cdn-cgi/styles/challenges.css" rel="stylesheet">
-    <meta http-equiv="refresh" content="35">

h<script src="/cdn-cgi/challenge-platform/h/b/orchestrate/jsch/v1?ray=768b32223f27985e"></script></head>
<body class="no-js">
+    <div class="main-wrapper" role="main">
    <div class="main-content">
(        <h1 class="zone-name-title h1">
{            <img class="heading-favicon" src="/favicon.ico" onerror="this.onerror=null;this.parentNode.removeChild(this)">
            kp.m-team.cc
        </h1>
/        <h2 class="h2" id="challenge-running">
6            Checking if the site connection is secure
�        </h2><div id="challenge-stage" style="display: none;"></div><div id="challenge-spinner" class="spacer loading-spinner" style="display: block; visibility: visible;"><div class="lds-ring"><div></div><div></div><div></div><div></div></div></div>
        <noscript>
-            <div id="challenge-error-title">
!                <div class="h2">
0                    <span class="icon-wrapper">
F                        <div class="heading-icon warning-icon"></div>
                    </span>
5                    <span id="challenge-error-text">
B                        Enable JavaScript and cookies to continue
                    </span>
                </div>
            </div>
        </noscript>
�        <div id="trk_jschal_js" style="display:none;background-image:url('/cdn-cgi/images/trace/jsch/nojs/transparent.gif?ray=768b32223f27985e')"></div>
?        <div id="challenge-body-text" class="core-msg spacer">
\            kp.m-team.cc needs to review the security of your connection before proceeding.
m        </div><div id="challenge-fact-wrapper" class="fact spacer hidden" style="display: block; visibility: visible;"><span class="fact-title">Did you know</span> <span id="challenge-fact" class="body-text">43% of cyber attacks target small businesses?</span></div><div id="challenge-explainer-expandable" class="hidden expandable body-text spacer" style="display: none;"><div class="expandable-title" id="challenge-explainer-summary"><button class="expandable-summary-btn" id="challenge-explainer-btn" type="button">Why am I seeing this page?<span class="caret-icon-wrapper"> <div class="caret-icon"></div> </span> </button> </div> <div class="expandable-details" id="challenge-explainer-details">Requests from malicious bots can pose as legitimate traffic. Occasionally, you may see this page while the site ensures that the connection is secure.</div></div><div id="challenge-success" style="display: none;"><div class="h2"><span class="icon-wrapper"><img class="heading-icon" alt="Success icon" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAADQAAAA0CAMAAADypuvZAAAANlBMVEUAAAAxMTEwMDAxMTExMTEwMDAwMDAwMDAxMTExMTExMTEwMDAwMDAxMTExMTEwMDAwMDAxMTHB9N+uAAAAEXRSTlMA3zDvfyBAEJC/n3BQz69gX7VMkcMAAAGySURBVEjHnZZbFoMgDEQJiDzVuv/NtgbtFGuQ4/zUKpeMIQbUhXSKE5l1XSn4pFWHRm/WShT1HRLWC01LGxFEVkCc30eYkLJ1Sjk9pvkw690VY6k8DWP9OM9yMG0Koi+mi8XA36NXmW0UXra4eJ3iwHfrfXVlgL0NqqGBHdqfeQhMmyJ48WDuKP81h3+SMPeRKkJcSXiLUK4XTHCjESOnz1VUXQoc6lgi2x4cI5aTQ201Mt8wHysI5fc05M5c81uZEtHcMKhxZ7iYEty1GfhLvGKpm+EYkdGxm1F5axmcB93DoORIbXfdN7f+hlFuyxtDP+sxtBnF43cIYwaZAWRgzxIoiXEMESoPlMhwLRDXeK772CAzXEdBRV7cmnoVBp0OSlyGidEzJTFq5hhcsA5388oSGM6b5p+qjpZrBlMS9xj4AwXmz108ukU1IomM3ceiW0CDwHCqp1NjAqXlFrbga+xuloQJ+tuyfbIBPNpqnmxqT7dPaOnZqBfhSBCteJAxWj58zLk2xgg+SPGYM6dRO6WczSnIxxwEExRaO+UyCUhbOp7CGQ+kxSUfNtLQFC+Po29vvy7jj4y0yAAAAABJRU5ErkJggg=="></span>Connection is secure</div><div class="core-msg spacer">Proceeding...</div></div>
�        <form id="challenge-form" action="/login.php?__cf_chl_f_tk=u43EMII5SPYfKCbLKZL7L4IQW.bnmnxKiFrmzjH1cuY-1668213412-0-gaNycGzNCGU" method="POST" enctype="application/x-www-form-urlencoded">
�            <input type="hidden" name="md" value="u.hmH.CtTezS4.l6PynrCdChFwPhotULDidM.S94AYs-1668213412-0-AVej7tkEsBbh2koUz-RfQQDhQyaEf_0BwqR_-my6_9fLgIUy4w0WJrTVoYT6rS_8uJxJRCY0Elt4F3-ov1PD9TCWjYz6snaihGHu7xri_O1Nc3p0qsJgtRErRvrxStUdnDyr6zwpqAuECeB6Yoy_1qIFpajC-oAUfbOtp-MaIVehyC6BM4mOpmC6ZJWmdvY1Bxn4PIjvVk-YRQcqRjmggRWbLJmZ0WORGM_BkkLlIV2EeCKzTIE4gzDMn1z_r7IfNRZLziLrpF9Fu43eoTObeZpJzy5bdJRgKUiywhVT_e1cVp8qbEA_F99EYJUuTkDAyN1X8ONbuc0Xb1gm7lZu5_n4A36jRWsLDSuA2szkfIAsjqBPBgv08FnUvzjwRB7jRyUXKwRU3sd3XaTkcJ753UKlHzEPgBKkU5nctx_SgGShR33EojaWVW4s7r9--mrZ155jnpE7I2SNnq_to2schw25epRaBnlL-qaOl95Ak_EvYfW6ft5AgoJGtEaPkHTeWSIViVftQbtaigo14OWbLfRE7bE8Y3qKI4B_7fPlejGKYyNsRKSePzg-bsFMD38Ua9tQvwk3tTu_NPbfCxjAiXbx5ZKDcFQ9sje7vxeTUUis39BogVO2BXdBpi1Jtpn71A">
�            <input type="hidden" name="r" value="5ryyh4MrEq269lKeV3lQwzpOqnV0SFy4Sz4fcM91Qbg-1668213412-0-AZ1w1NqJ6O+L+XmFhrN8Hf8SDKVKTLbgKSkGPWzOAEJMxfADXSNBw80rEYiP4UAlc+LpxZb/yPUzqeVt5WXmNUBIsRpWZ5rUi1oyJsTZFkPBfKgt3oY70tCYLIMi3OGRrSB/u9fp83JfN9gTeX/r8os+PJ0d2OqVhIWeanD0VAaDUePe+onojeBayS2Yg3x/v590jIiC+DzBdINZ8JGRW1s692x1mNMmHRE9YAIIo9pO/XcYKSOKKPkl1Lwy8jci2l8b3X/YM5tbbUqlz0lrkhq2GGLhUxUhetvCbHWoKn6qknZicdeVEXQ2J6lQiK67RFeALNXvMvyH7+lcGLrcZFnt2X5w2ZGouJCyBDVEs1EXcr2MzQTUlpqnDxpTKLXh6TX1iP/PmT9EtPL3Wj/4Zo46fxC1RU5noaQkw2VrgsxVZFIHZcsS7YVmJ+SkQdAnAOvSRhEgR0ZhPY9H6YVTa5PEttctB6DnazDyHeDSJhqbCdjtVZjZfvDqkNk0TaSMbKzrljq4MuP/Ke4QM5KS/P2Jk5Xj69E6MeyOYWhhw2+1oOPdDaU9X9j58r3dMCwOdiUwetjAsq+1MQ83bywkj/3ZBUwgWdOxVnXluikSsvpPNYJ/EX5r2+e/7n/h3htP55W0mosdMD1x3twhEF5D+BqGEfSVoXhwBzzCEnkPeRoW7SJ67UnIFabCUuaHEfjVHqg7kB/OZ7mL8Jh4zbHMwb5ID7CJSXqMvHEDjjDUxnzh6e/LPv267bC9BaM5I86iyh9U7BhnsL3CuWld9vlOSS2Pi94HTpYkrpaH2NEvjYLxzSUGD+pUi3ahBVXvgVJybreWetrrdc4W12sWMoIM/hk+FRbXrZVcOpfXxRUG670hs/blTlwASJH/ynH1XxBAl3WD1apc/TZmfR+iF9BIEV/qiZOBo+yIt1R9YCSChK56rsFJcnjJ/4hJZ41jmZoUK41c/RSfpRvhxcFWuVM3932V6AscfQM2hl64ESpjnYJxyK3b0swsUNlpMrZOq/6UtpWgoNRmORxnUVfvNOlHQD4nhzxS9VcMpbXoeouRSwgMRdRHOJWbqTVcwJ9orVfi7xd0m+/aXyyOhZgWj5edrkp57GT9aRKxODpll2HayN6bcXyaCXf2xMJr3SZgj7dRpFe/B7qS9KNBIaU+Y/TZT7+FEwkcZoijxX4MgwFXOlYkJcJW49Ey0ZeBvTodowM9rPyoX1DXbrxo8vYWjNOBCEph0y6yGCfSuPYRjFVmkS15JWrloHDrzHEN9TDKa5P1Ih2O1xFO1+s/kSPg5OPvj5SI/AQb0wSb8u5b98GPusivCEvZhSemmPTxEzF1IYl0VqfyYZK3joLErkCoeYz9SfC8XjJ5PiEDMWSLMy8HkT7Q+8ZmnWYjrlsO5aTPbZLdSjQGCqchcSIVSQd8hA2o0mCe/GSOZsAZqMT5eZjiiY7h4raHtRmrKm5+b9yTfQgsgO+DlWL/APUxiibxx9Q0ZakzTlu1lK5lOozpPLr5KFNLMfhI6SxEYflrLY8F6CqpVo/BVCuz9K2wmRF04cxAQUMWNsnfGTWgsPvU33Og/ErEG14DzZBy1GLeqYKQkg/eNqcz0EsnZt3xYCmRkbzSNC+JFHJU3w/0bOX82yAhJXbDjrugKNdJP2gumRTO68fHGWXzWyfXWuRxs3yL0oXosTnHIDDEhSoe2khJtuGXKeWoTiCJwyYhFpByrZ9drNo4pcM/Hw53E9zZXUSc91TWls4AftI2vJPL0RyBF5eJed+PQmJQNx7lhI6RJ4yuu3yn85vAm8mCw05tlh9PsFOgAlFANFYZij7AlQWBPxBgg9EBhrn5rNRYc6R8tDg+AlaVhAUoDRBA9Ek6vVTzQMuZoTZh/Zz4JaZ+89x2PV9Gx7IgjJUxA9opOpfXdnsQyG2836a1Egju6xEwmQGIgiV2lzk1pkhLf0kSfG5jAQ50/DXnK/Lftafhs9COoarbOvVJiMcKPhjzllXjmSdXo8z7libvxlwOxO+RZ+5+rvXk8fFgpqSl4M/z+gqG9rP8k0cN75NzoQa5Fyq7inHdl3H1CER13jpgo4szNIiyqomwEsnl">
~        <span style="display: none;"><span class="text-gray-600" data-translate="error">error code: 1020</span></span></form>
    </div>
</div>
   <script>
    (function(){
        window._cf_chl_opt={
            cvId: '2',
&            cType: 'non-interactive',
            cNounce: '3663',
&            cRay: '768b32223f27985e',
&            cHash: 'ca3cd0c9cd0ecde',
u            cUPMDTk: "\/login.php?__cf_chl_tk=u43EMII5SPYfKCbLKZL7L4IQW.bnmnxKiFrmzjH1cuY-1668213412-0-gaNycGzNCGU",
            cFPWv: 'b',
            cTTimeMs: '1000',
            cTplV: 4,
            cTplB: 'cf',
            cRq: {
@                ru: 'aHR0cHM6Ly9rcC5tLXRlYW0uY2MvbG9naW4ucGhw',
�                ra: 'TW96aWxsYS81LjAgKFgxMTsgTGludXggeDg2XzY0KSBBcHBsZVdlYktpdC81MzcuMzYgKEtIVE1MLCBsaWtlIEdlY2tvKSBDaHJvbWUvMTA2LjAuMC4wIFNhZmFyaS81MzcuMzY=',
                rm: 'R0VU',
o                d: 'c8yH85HciRiXq3U/KN0hhftzs2/VtAnVl3xS3isqLs72DTRO2UhZJlHe8VD5d98IwQOEew4+Sa1A68fJZc1nVkccyVj7A3GWt0HtkZbUDFeUb/rfLcJyDzqWUzgi+jo0csBIYHb2CFoCXsdfluJjn06m/fEdzt/Z2mm5QEBu4+eZ5hn1nILTaOS9f7qwhtBlVJJX7pJ4nSQuzthy61VCnI5KceiZ8MCA0OyfYYJpO0pvyN/rPd0Euonh1Mcy1WPIYsz77JJomAPn7Tvjgg1kvQjwzBG1BePOqWRAPle1AeUbtc1Ebm9DbuR8THq1jX/5mUdPtVODiKttNeMDSgeOr+I+HBG5v07JuOImel35u+qegOHn8OPB1NKgwSU1Wgn9suxoO76pLouZZMDiWzPMX5VkqHhRF+WAY02o7Qa8X/TdSgA3QYS5vpncJ7hszF6JHwwNegCkTC+MHrUu/9bC24/f0l8C+MYcyQwS5OzVhyVhQGOSBp1+1yzkuB5n+1y0enot458W3U66wpb2gzVoJCovZe7o/jMVnplkmvG8RB5h9+1N433urviYMpZ1W/Qo0H/E6Yis7JNPaobzhSXSHA==',
/                t: 'MTY2ODIxMzQxMi4yMDAwMDA=',
C                m: 'qio3uEzYbT+9WHfA6ScBty+OrtH98JuTNCXAzoyVhf8=',
0                i1: 'kPLunAf2khlyOABp1qMhrQ==',
0                i2: 'kycDTOpYWnittmoTHyiGLQ==',
D                zh: 'ycW2tLa5sOEskrRrKYD9aTfh1CimefR9+rFfbc2fii8=',
D                uh: 'sBB8sEmOP4iYQTUEC/oaJy8CMO8k7wrxWamrx0AoHIw=',
D                hh: 'tKPr5EygkgrRKsUltfzSF5aRVXg3cPORbjqdVQUKOMA=',
            }
        };
3        var trkjs = document.createElement('img');
i        trkjs.setAttribute('src', '/cdn-cgi/images/trace/jsch/js/transparent.gif?ray=768b32223f27985e');
6        trkjs.setAttribute('style', 'display: none');
*        document.body.appendChild(trkjs);
4        var cpo = document.createElement('script');
^        cpo.src = '/cdn-cgi/challenge-platform/h/b/orchestrate/jsch/v1?ray=768b32223f27985e';
w        window._cf_chl_opt.cOgUHash = location.hash === '' && location.href.indexOf('#') !== -1 ? '#' : location.hash;
�        window._cf_chl_opt.cOgUQuery = location.search === '' && location.href.slice(0, -window._cf_chl_opt.cOgUHash.length).indexOf('?') !== -1 ? '?' : location.search;
=        if (window.history && window.history.replaceState) {
f            var ogU = location.pathname + window._cf_chl_opt.cOgUQuery + window._cf_chl_opt.cOgUHash;
�            history.replaceState(null, null, "\/login.php?__cf_chl_rt_tk=u43EMII5SPYfKCbLKZL7L4IQW.bnmnxKiFrmzjH1cuY-1668213412-0-gaNycGzNCGU" + window._cf_chl_opt.cOgUHash);
&            cpo.onload = function() {
7                history.replaceState(null, null, ogU);
            };

        }
C        document.getElementsByTagName('head')[0].appendChild(cpo);

    }());
n</script><img src="/cdn-cgi/images/trace/jsch/js/transparent.gif?ray=768b32223f27985e" style="display: none">


,    <div class="footer" role="contentinfo">
#        <div class="footer-inner">
6            <div class="clearfix diagnostic-wrapper">
P                <div class="ray-id">Ray ID: <code>768b32223f27985e</code></div>
            </div>
�            <div class="text-center">Performance &amp; security by <a rel="noopener noreferrer" href="https://www.cloudflare.com?utm_source=challenge&amp;utm_campaign=j" target="_blank">Cloudflare</a></div>
        </div>
    </div>


/<span id="trk_jschal_js"></span></body></html>
f2022-11-12 08:36:52 INFO     ReqId 139696411760384 Challenge detected. Selector found: #trk_jschal_js
_2022-11-12 08:36:52 DEBUG    ReqId 139696411760384 Waiting for selector: #cf-challenge-running
Q2022-11-12 08:36:52 DEBUG    ReqId 139696411760384 Waiting for selector: .ray_id
U2022-11-12 08:36:52 DEBUG    ReqId 139696411760384 Waiting for selector: .attack-box
Y2022-11-12 08:36:52 DEBUG    ReqId 139696411760384 Waiting for selector: #cf-please-wait
X2022-11-12 08:36:52 DEBUG    ReqId 139696411760384 Waiting for selector: #trk_jschal_js
P2022-11-12 08:36:58 DEBUG    ReqId 139696411760384 Timeout waiting for selector
...repeat
_2022-11-12 08:37:50 DEBUG    ReqId 139696411760384 Waiting for selector: #cf-challenge-running
Q2022-11-12 08:37:50 DEBUG    ReqId 139696411760384 Waiting for selector: .ray_id
U2022-11-12 08:37:50 DEBUG    ReqId 139696411760384 Waiting for selector: .attack-box
Y2022-11-12 08:37:50 DEBUG    ReqId 139696411760384 Waiting for selector: #cf-please-wait
X2022-11-12 08:37:50 DEBUG    ReqId 139696411760384 Waiting for selector: #trk_jschal_js
s2022-11-12 08:37:51 ERROR    ReqId 139696520779520 Error: Error solving the challenge. Timeout after 60.0 seconds.

2022-11-12 08:37:51 DEBUG    ReqId 139696520779520 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 60.0 seconds.', 'startTimestamp': 1668213410741, 'endTimestamp': 1668213471593, 'version': '3.0.0.beta3'}
H2022-11-12 08:37:51 INFO     ReqId 139696520779520 Response in 60.852 s
v2022-11-12 08:37:51 INFO     ReqId 139696520779520 172.17.0.1 POST http://127.0.0.1:8191/v1 500 Internal Server Error
yetdog commented 2 years ago

Having same issue as @marujun on another site, https://setlistpub.davematthewsband.com/SetlistNSPub.asp?show_id=1290023

Waiting for selectors, and then timeout waiting for selector.

Deathnetworks commented 2 years ago

Getting trk_jschal_js issue

2022-11-18 01:06:23 INFO     Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ranobes.net/chapters/1205136/'}
2022-11-18 01:06:24 INFO     Challenge detected. Selector found: #trk_jschal_js
2022-11-18 01:09:24 ERROR    Error: Error solving the challenge. Timeout after 180.0 seconds.
2022-11-18 01:09:24 INFO     Response in 180.799 s
2022-11-18 01:09:24 INFO     172.17.0.1 POST http://localhost:8191/v1 500 Internal Server Error
nicandris commented 1 year ago

hey, i've been using the beta for a few days. I noticed a lot of zombie processes being left behind

nichome     4269  0.0  0.0      0     0 ?        Zs   Dec03   0:00 [chromium] <defunct>
nichome     4357  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome     4359  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome     4368  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4369  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4430  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4452  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4556  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4862  0.0  0.0      0     0 ?        Zs   Dec03   0:00 [chromium] <defunct>
nichome     4898  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome     4900  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome     4903  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4904  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     4982  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     5001  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome     5124  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    15986  0.0  0.0      0     0 ?        Zs   Dec03   0:00 [chromium] <defunct>
nichome    16008  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome    16010  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome    16013  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    16014  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    16036  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    16062  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    16117  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    16130  0.0  0.0      0     0 ?        Z    Dec03   0:01 [chromium] <defunct>
nichome    21369  0.0  0.0      0     0 ?        Zs   Dec03   0:00 [chromium] <defunct>
nichome    21391  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome    21393  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome    21396  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    21397  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    21426  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    21430  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    21501  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    40650  0.0  0.0      0     0 ?        Zs   Dec03   0:00 [chromium] <defunct>
nichome    40673  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome    40675  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome    40678  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    40679  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    40703  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    40728  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome    40794  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome   291494  0.0  0.0      0     0 ?        Zs   Dec03   0:00 [chromium] <defunct>
nichome   291516  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome   291518  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chrome_crashpad] <defunct>
nichome   291521  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome   291522  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome   291544  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome   291570  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome   291652  0.0  0.0      0     0 ?        Z    Dec03   0:00 [chromium] <defunct>
nichome   543180  0.0  0.0      0     0 ?        Zs   05:19   0:00 [chromium] <defunct>
nichome   543202  0.0  0.0      0     0 ?        Z    05:19   0:00 [chrome_crashpad] <defunct>
nichome   543204  0.0  0.0      0     0 ?        Z    05:19   0:00 [chrome_crashpad] <defunct>
nichome   543207  0.0  0.0      0     0 ?        Z    05:19   0:00 [chromium] <defunct>
nichome   543208  0.0  0.0      0     0 ?        Z    05:19   0:00 [chromium] <defunct>
nichome   543236  0.0  0.0      0     0 ?        Z    05:19   0:00 [chromium] <defunct>
nichome   543241  0.0  0.0      0     0 ?        Z    05:19   0:00 [chromium] <defunct>
nichome   543312  0.0  0.0      0     0 ?        Z    05:19   0:00 [chromium] <defunct>
nichome   795355  0.0  0.0      0     0 ?        Z    11:19   0:00 [python] <defunct>
nichome   795356  0.0  0.0      0     0 ?        Zs   11:19   0:00 [chromium] <defunct>
nichome   795378  0.0  0.0      0     0 ?        Z    11:19   0:00 [chrome_crashpad] <defunct>
nichome   795380  0.0  0.0      0     0 ?        Z    11:19   0:00 [chrome_crashpad] <defunct>
nichome   795383  0.0  0.0      0     0 ?        Z    11:19   0:00 [chromium] <defunct>
nichome   795384  0.0  0.0      0     0 ?        Z    11:19   0:00 [chromium] <defunct>
nichome   795412  0.0  0.0      0     0 ?        Z    11:19   0:00 [chromium] <defunct>
nichome   795417  0.0  0.0      0     0 ?        Z    11:19   0:00 [chromium] <defunct>
nichome   795603  0.0  0.0      0     0 ?        Z    11:19   0:00 [chromium] <defunct>

a couple of them might be my python healthcheck but the rest are coming from this. Ideas?

AeonLucid commented 1 year ago

Thanks for the work on the new v3 beta. I've forked it and continued to work on it. https://github.com/AeonLucid/FlareSolverr

Changes:

I might revert the Dockerfile changes in the future, but this has been working for me so far.

You can try it with docker image ghcr.io/aeonlucid/flaresolverr:v3.0.0, warning huge docker image (~500MB).

docker run -d \
  --name=flaresolverr \
  -p 8191:8191 \
  -e LOG_LEVEL=debug \
  -e 2CAPTCHA_KEY=KEY \
  --restart always \
  ghcr.io/aeonlucid/flaresolverr:v3.0.0

(Remove the -e 2CAPTCHA_KEY=KEY \ line if you do not have an API key)

xJayson commented 1 year ago

@AeonLucid doesn't bypass MTeam or HDT.. sadly

AeonLucid commented 1 year ago

@AeonLucid doesn't bypass MTeam or HDT.. sadly

Post an issue at my GitHub repository with more information and an example and I will check it out.

xJayson commented 1 year ago

@AeonLucid doesn't bypass MTeam or HDT.. sadly

Post an issue at my GitHub repository with more information and an example and I will check it out.

Ok, will do.

btw should I use:

docker pull ghcr.io/aeonlucid/flaresolverr:v3.0.0 or docker pull ghcr.io/aeonlucid/flaresolverr:v3beta

AeonLucid commented 1 year ago

@xMetformin v3.0.0

ilike2burnthing commented 1 year ago

@AeonLucid do you want to make a PR? I'll email @ngosang to see they can review, maybe bring you on board.

lifefloating commented 1 year ago

undetected_chromedriver headless can be detected, i solve it like this image you can try this method, just my test case

7161457 commented 1 year ago

undetected_chromedriver headless 可以检测到，我是这样解决的 你可以试试这个方法，只是我的测试用例 图片

这一段是贴在什么地方的？更改那段代码？

SmartPhoneLover commented 1 year ago

Thanks for the work on the new v3 beta. I've forked it and continued to work on it. https://github.com/AeonLucid/FlareSolverr

Changes:

* Changed dockerfile to use Ubuntu 22.04.

* Updated chromium to `108.0.5359.40`

* Updated undetected_chromium to `3.1.7`.

* Added support for detecting captchas (solving endless waiting for selectors loop).

* Added support for Cloudflare turnstile captcha.

* Added support for hCaptcha (through [2captcha](https://2captcha.com/)).

* Added cookies support.

I might revert the Dockerfile changes in the future, but this has been working for me so far.

You can try it with docker image ghcr.io/aeonlucid/flaresolverr:v3.0.0, warning huge docker image (~500MB).

docker run -d \
  --name=flaresolverr \
  -p 8191:8191 \
  -e LOG_LEVEL=debug \
  -e 2CAPTCHA_KEY=KEY \
  --restart always \
  ghcr.io/aeonlucid/flaresolverr:v3.0.0

(Remove the -e 2CAPTCHA_KEY=KEY \ line if you do not have an API key)

Tried latest beta available of yours with HDSpace tracker, and it's currently working perfect. The other ones (official and the other docker from another user) doesn't work.

Many many thanks for continue with the project!

Update: I noticed a lot of (many) problems with this tracker (HDSpace). Seems that it only accepts a single request, once every x time. If you try to perform requests from *rr apps once the tracker is added to Prowlarr, it just fails all the time. Also, Prowlarr itself makes it not to be available anymore as per its own scheduled checks. (sorry my english)

Update (2): Seems to be working well now. I disabled and re-enabled it from Prowlarr settings.

chiragkrishna commented 1 year ago

HD-Space

not working using docker image: ngosang/flaresolverr:3.0.0.beta3

its working using this fork of flaresolverr docker image: ghcr.io/aeonlucid/flaresolverr:v3.0.0

version: "2.1"
services:
  flaresolverr:
    image: ghcr.io/aeonlucid/flaresolverr:latest
    container_name: "flaresolverr"
    environment:
      - "LOG_LEVEL=info"
      - "LOG_HTML=false"
      - "TZ=Asia/Kolkata"
      - "2CAPTCHA_KEY=MYKEY"
    ports:
      - "8191:8191"
    restart: "unless-stopped"
Zeromark30 commented 1 year ago

Thanks for the work on the new v3 beta. I've forked it and continued to work on it. https://github.com/AeonLucid/FlareSolverr Changes:

* Changed dockerfile to use Ubuntu 22.04.

* Updated chromium to `108.0.5359.40`

* Updated undetected_chromium to `3.1.7`.

* Added support for detecting captchas (solving endless waiting for selectors loop).

* Added support for Cloudflare turnstile captcha.

* Added support for hCaptcha (through [2captcha](https://2captcha.com/)).

* Added cookies support.

I might revert the Dockerfile changes in the future, but this has been working for me so far. You can try it with docker image ghcr.io/aeonlucid/flaresolverr:v3.0.0, warning huge docker image (~500MB).

docker run -d \
  --name=flaresolverr \
  -p 8191:8191 \
  -e LOG_LEVEL=debug \
  -e 2CAPTCHA_KEY=KEY \
  --restart always \
  ghcr.io/aeonlucid/flaresolverr:v3.0.0

(Remove the -e 2CAPTCHA_KEY=KEY \ line if you do not have an API key)

Tried latest beta available of yours with HDSpace tracker, and it's currently working perfect. The other ones (official and the other docker from another user) doesn't work.

Many many thanks for continue with the project!

Update: I noticed a lot of (many) problems with this tracker (HDSpace). Seems that it only accepts a single request, once every x time. If you try to perform requests from *rr apps once the tracker is added to Prowlarr, it just fails all the time. Also, Prowlarr itself makes it not to be available anymore as per its own scheduled checks. (sorry my english)

I got https://github.com/AeonLucid/FlareSolverr to work to pass HDSpace cloudflare checks but it fails trying to save in prowlarr because it sends a second post request (with username/password) to quickly

Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2022-12-13 03:28:22 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2022-12-13 03:28:24 INFO Challenge detected. Selector found: #challenge-spinner 2022-12-13 03:28:30 INFO Challenge solved! 2022-12-13 03:28:30 INFO Response in 8.084 s 2022-12-13 03:28:30 INFO ** POST ***/v1 200 OK

2022-12-13 03:28:31 INFO Incoming request => POST /v1 body: {'headers': {'contentType': 'application/x-www-form-urlencoded'}, 'postData': 'uid=**&pwd=**', 'maxTimeout': 60000, 'cmd': 'request.post', 'url': 'https://hd-space.org/index.php?page=login', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2022-12-13 03:28:31 WARNING Request parameter 'headers' was removed in FlareSolverr v2. 2022-12-13 03:28:31 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2022-12-13 03:28:32 INFO Challenge detected. Selector found: #challenge-spinner 2022-12-13 03:28:39 INFO Challenge solved! 2022-12-13 03:28:39 INFO Response in 8.073 s 2022-12-13 03:28:39 INFO POST /v1 200 OK

SmartPhoneLover commented 1 year ago

HD-Space

not working using docker image: ngosang/flaresolverr:3.0.0.beta3

its working using this fork of flaresolverr docker image: ghcr.io/aeonlucid/flaresolverr:v3.0.0

version: "2.1"
services:
  flaresolverr:
    image: ghcr.io/aeonlucid/flaresolverr:latest
    container_name: "flaresolverr"
    environment:
      - "LOG_LEVEL=info"
      - "LOG_HTML=false"
      - "TZ=Asia/Kolkata"
      - "2CAPTCHA_KEY=MYKEY"
    ports:
      - "8191:8191"
    restart: "unless-stopped"

I have it configured without proving any value for the '2CAPTCHA_KEY' var, and it's working just well for me. Did you? Also, using same tag, so same image version: v3.0.0

SmartPhoneLover commented 1 year ago

I got https://github.com/AeonLucid/FlareSolverr to work to pass HDSpace cloudflare checks but it fails trying to save in prowlarr because it sends a second post request (with username/password) to quickly

Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2022-12-13 03:28:22 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2022-12-13 03:28:24 INFO Challenge detected. Selector found: #challenge-spinner 2022-12-13 03:28:30 INFO Challenge solved! 2022-12-13 03:28:30 INFO Response in 8.084 s 2022-12-13 03:28:30 INFO ** POST ***/v1 200 OK

2022-12-13 03:28:31 INFO Incoming request => POST /v1 body: {'headers': {'contentType': 'application/x-www-form-urlencoded'}, 'postData': 'uid=**&pwd=**', 'maxTimeout': 60000, 'cmd': 'request.post', 'url': 'https://hd-space.org/index.php?page=login', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2022-12-13 03:28:31 WARNING Request parameter 'headers' was removed in FlareSolverr v2. 2022-12-13 03:28:31 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2022-12-13 03:28:32 INFO Challenge detected. Selector found: #challenge-spinner 2022-12-13 03:28:39 INFO Challenge solved! 2022-12-13 03:28:39 INFO Response in 8.073 s 2022-12-13 03:28:39 INFO POST /v1 200 OK

I was experiencing exactly the same situation as you yesterday. But, after disabling it (from Prowlarr) and enabling it after a couple of minutes, it didn't show any error in Prowlarr since.

In short, I can make requests from Radarr/Sonarr, and Prowlarr sends back the results of HDSpace without any problem now.

fede843 commented 1 year ago

Hello, I am testing this version too. (3.0.0.beta3)

I am troubleshooting some issues I am experiencing in a docker instance running in a rpi4 64bits. System get overloaded over time. I have started to keep an eye on deployed containers and system metrics, and noticed this:

docker stats flaresolverr
CONTAINER ID   NAME            CPU %     MEM USAGE / LIMIT   MEM %     NET I/O           BLOCK I/O         PIDS
12e2f584e29c   flaresolverr    0.03%     0B / 0B             0.00%     111MB / 12.6MB    14.4GB / 1.06MB   799

Those are 800 processes. Container has been running for 44 hours only and I suspect that will keep growing over time until system get totally loaded and crashes. Have sonnar/radarr/prowlarr with defaults configurations hitting this service, and there is no much else going on. The usage is very low.

I see some other user has posted about zombie processes. This might be related. Let me know if I can help somehow.

Thanks!

chiragkrishna commented 1 year ago

I have it configured without proving any value for the '2CAPTCHA_KEY' var, and it's working just well for me. Did you? Also, using same tag, so same image version: v3.0.0

it is working with or without "2CAPTCHA_KEY"

Steps taken 1) use ghcr.io/aeonlucid/flaresolverr:latest docker image 2) test HD-Space indexer --> green tick mark 3) dont save but close and wait 1 hour and so 4) this time add HD-Space indexer and dont test it, directly save it.

plexxman commented 1 year ago

This beta version is working for me with Jackett Version v0.20.2384 and BT4G. Thanks!

hastalamuerte commented 1 year ago

Hello, sorry for double . Cant use FlareSolver as a proxy . i was try 2 versions master stable for windows and python beta 3 with crome browser (FlareSolver py cant find chromium with standalone not installed - help plz with it too) i was start exe. It start instance, but i cant connect any browser or anything by adding 0.0.0.0 / localhost /127.0.0.1, with http / https, with ports 8888 / 8189 - nothing i was start python instance 2022-12-15 05:55:39 INFO Test successful 2022-12-15 05:56:04 INFO Serving on http://0.0.0.0:8191/

but nothing. plz help

ilike2burnthing commented 1 year ago

For the beta you need Chrome or Chromium installed.

If you're trying to access FlareSolverr on the same Windows device that's running it, use http://127.0.0.1:8191.

guice commented 1 year ago

I just ran across this and happy to report ngosang/flaresolverr:3.0.0.beta3 fixed my Jackett and Prowlarr issues. Not to mention, it's much, much more resource friendly.

hastalamuerte commented 1 year ago

For the beta you need Chrome or Chromium installed.

If you're trying to access FlareSolverr on the same Windows device that's running it, use http://127.0.0.1:8191.

I got chrome , chromium. Flare saw version of build. It started. I try to acces from same device. But cant ..

ilike2burnthing commented 1 year ago

What do you see in browser when trying to access that IP and port? Does this occur in different browsers? Does anything appear in the FlareSolverr log/console?

hastalamuerte commented 1 year ago

ok

flareresolverr win latest log 2022-12-16T05:22:34-04:00 INFO FlareSolverr v2.2.10 2022-12-16T05:22:34-04:00 INFO Testing web browser installation... 2022-12-16T05:22:37-04:00 INFO FlareSolverr User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:94.0) Gecko/20100101 Firefox/94.0 2022-12-16T05:22:37-04:00 INFO Test successful 2022-12-16T05:22:37-04:00 INFO Listening on http://0.0.0.0:8191

firefox try http://127.0.0.1:8189/ Unable to connect chrome (WOW! something new) ok - http://127.0.0.1:8191/ {"msg":"FlareSolverr is ready!","version":"v2.2.10","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:94.0) Gecko/20100101 Firefox/94.0"}

but i cant connect it by my app , by foxy proxy, by proxyomegaswitch. nothing((

flaresolverr 3.0 beta python .\src\flaresolverr.py 2022-12-16 06:01:24 INFO FlareSolverr 3.0.0.beta2 2022-12-16 06:01:24 INFO Testing web browser installation... 2022-12-16 06:01:24 INFO Chrome major version: 108 2022-12-16 06:01:29 INFO FlareSolverr User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36 2022-12-16 06:01:29 INFO Test successful 2022-12-16 06:01:29 INFO Serving on http://0.0.0.0:8191

firefox try to localhost 8189 - nothing again chrome - {"msg": "FlareSolverr is ready!", "version": "3.0.0.beta2", "userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"} in console Flare - 2022-12-16 06:02:15 INFO 127.0.0.1 GET http://127.0.0.1:8191/ 200 OK

foxyproxy , proxyomega - nothing in my app -- Invalid user profile data or Validation errors

help plz

ilike2burnthing commented 1 year ago

Ok, so they're working fine then. What are you trying to accomplish by setting them up as proxies in browser extensions?

hastalamuerte commented 1 year ago

Honestly ))) i was try to connect web parser with FlareSolverr ) But always have an errors. By default all traffic not goes through FlareSolverr + i use all with OPENVPN connect (but with letting use local dns resolvers - setting let use dns req to 127... and ::1 ) Also i have no IPV6 and have some manual hosts file editions 127.0.0.1 localhost 127.0.1.1 PC with no hashtag)

my app succesfully connect for example to a free proxy 131.0.226.198 port 9898 trying to solve the quest . thanks for helping

maybe i should run FlareSolverr with some options for upstream proxy?

P.s Think sollution will be use jacket or proxifier or proxify all traffic to FlareSollver