FlareSolverr / FlareSolverr

Proxy server to bypass Cloudflare protection
MIT License
5.99k stars 533 forks source link

[Flaresolverr Bug] Flaresolverr is unable to find checkbox on page, on multiple sites: yggtorrent,hd-torrent,etc. #1173

Closed CyberPoison closed 1 month ago

CyberPoison commented 1 month ago

Have you checked our README?

Have you followed our Troubleshooting?

Is there already an issue for your problem?

Have you checked the discussions?

Environment

- FlareSolverr version: FlareSolverr 3.3.17
- Last working FlareSolverr version: FlareSolverr 3.3.17
- Operating system: Kuberenetes (Rancher)
- Are you using Docker: yes
- FlareSolverr User-Agent (see log traces or / endpoint): Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
- Are you using a VPN: yes (Tested with and without)
- Are you using a Proxy: no
- Are you using Captcha Solver: no
- If using captcha solver, which one: N/A
- URL to test this issue: https://www3.yggtorrent.cool/engine/search?do=search&order=desc&sort=publish_date&category=all

Description

The flaresolverr is unable to find the checkbox, and end with (Error solving the challenge. Timeout after ...).

I have tested with vpn, and without, not tested yet with decentralized vpn.

Logged Error Messages


Container: container-0
Filter
Connected
2024-05-02 12:55:00 INFO     ReqId 140062502795072 FlareSolverr 3.3.17
2024-05-02T12:55:00.881447048Z 2024-05-02 12:55:00 DEBUG    ReqId 140062502795072 Debug log enabled
2024-05-02T12:55:00.881453527Z 2024-05-02 12:55:00 INFO     ReqId 140062502795072 Testing web browser installation...
2024-05-02T12:55:00.887681451Z 2024-05-02 12:55:00 INFO     ReqId 140062502795072 Platform: Linux-5.4.0-177-generic-x86_64-with-glibc2.31
2024-05-02T12:55:00.888291793Z 2024-05-02 12:55:00 INFO     ReqId 140062502795072 Chrome / Chromium path: /usr/bin/chromium
2024-05-02T12:55:01.073592169Z 2024-05-02 12:55:01 INFO     ReqId 140062502795072 Chrome / Chromium major version: 120
2024-05-02T12:55:01.073638648Z 2024-05-02 12:55:01 INFO     ReqId 140062502795072 Launching web browser...
2024-05-02T12:55:01.073676177Z 2024-05-02 12:55:01 DEBUG    ReqId 140062502795072 Launching web browser...
2024-05-02T12:55:01.234078610Z version_main cannot be converted to an integer
2024-05-02T12:55:01.425722391Z 2024-05-02 12:55:01 DEBUG    ReqId 140062502795072 Started executable: `/app/chromedriver` in a child process with pid: 31
2024-05-02T12:55:02.983394539Z 2024-05-02 12:55:02 INFO     ReqId 140062502795072 FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36
2024-05-02 12:55:02 INFO     ReqId 140062502795072 Test successful!
2024-05-02T12:55:03.007493144Z 2024-05-02 12:55:03 INFO     ReqId 140062502795072 Serving on http://0.0.0.0:8191
2024-05-02 12:55:52 INFO     ReqId 140062470235904 Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://www3.yggtorrent.cool/engine/search?do=search&order=desc&sort=publish_date&category=all'}
2024-05-02T12:55:52.159262500Z 2024-05-02 12:55:52 DEBUG    ReqId 140062470235904 Launching web browser...
2024-05-02T12:55:52.159558491Z version_main cannot be converted to an integer
2024-05-02 12:55:52 DEBUG    ReqId 140062470235904 Started executable: `/app/chromedriver` in a child process with pid: 185
2024-05-02 12:55:52 DEBUG    ReqId 140062470235904 New instance of webdriver has been created to perform the request
2024-05-02 12:55:52 DEBUG    ReqId 140062230570752 Navigating to... https://www3.yggtorrent.cool/engine/search?do=search&order=desc&sort=publish_date&category=all
2024-05-02 12:55:54 INFO     ReqId 140062230570752 Challenge detected. Title found: Just a moment...
2024-05-02T12:55:54.705424044Z 2024-05-02 12:55:54 DEBUG    ReqId 140062230570752 Waiting for title (attempt 1): Just a moment...
2024-05-02 12:55:55 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:55:55.744035041Z 2024-05-02 12:55:55 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:55:56 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:55:56 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:55:56 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:55:58 DEBUG    ReqId 140062230570752 Waiting for title (attempt 2): Just a moment...
2024-05-02 12:55:59 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:55:59.226353899Z 2024-05-02 12:55:59 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:55:59 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:55:59 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:55:59 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:01 DEBUG    ReqId 140062230570752 Waiting for title (attempt 3): Just a moment...
2024-05-02 12:56:02 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:02.515397997Z 2024-05-02 12:56:02 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:02 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:02 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:02 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:04 DEBUG    ReqId 140062230570752 Waiting for title (attempt 4): Just a moment...
2024-05-02 12:56:05 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02 12:56:05 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:05 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:05 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:05 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:08 DEBUG    ReqId 140062230570752 Waiting for title (attempt 5): Just a moment...
2024-05-02 12:56:09 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:09.147271330Z 2024-05-02 12:56:09 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:10 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:10 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:10 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:12 DEBUG    ReqId 140062230570752 Waiting for title (attempt 6): Just a moment...
2024-05-02 12:56:13 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:13.297825590Z 2024-05-02 12:56:13 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:13 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:13 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:13 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:15 DEBUG    ReqId 140062230570752 Waiting for title (attempt 7): Just a moment...
2024-05-02 12:56:16 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:16.576111995Z 2024-05-02 12:56:16 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:16 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:16 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:16 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:18 DEBUG    ReqId 140062230570752 Waiting for title (attempt 8): Just a moment...
2024-05-02 12:56:19 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:19.882292735Z 2024-05-02 12:56:19 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:20 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:20 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:20 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:22 DEBUG    ReqId 140062230570752 Waiting for title (attempt 9): Just a moment...
2024-05-02 12:56:23 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:23.167628499Z 2024-05-02 12:56:23 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:23 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:23 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:23 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:25 DEBUG    ReqId 140062230570752 Waiting for title (attempt 10): Just a moment...
2024-05-02 12:56:26 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02 12:56:26 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:26 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:26 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:26 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:28 DEBUG    ReqId 140062230570752 Waiting for title (attempt 11): Just a moment...
2024-05-02 12:56:29 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:29.718678574Z 2024-05-02 12:56:29 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:29 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:29 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:29 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:31 DEBUG    ReqId 140062230570752 Waiting for title (attempt 12): Just a moment...
2024-05-02 12:56:32 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:32.974528204Z 2024-05-02 12:56:32 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:33 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:33 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:33 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:35 DEBUG    ReqId 140062230570752 Waiting for title (attempt 13): Just a moment...
2024-05-02 12:56:36 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:36.248630164Z 2024-05-02 12:56:36 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:36 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:36 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:36 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:38 DEBUG    ReqId 140062230570752 Waiting for title (attempt 14): Just a moment...
2024-05-02 12:56:39 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:39.491395617Z 2024-05-02 12:56:39 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:39 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:39 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:39 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:41 DEBUG    ReqId 140062230570752 Waiting for title (attempt 15): Just a moment...
2024-05-02 12:56:42 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:42.779540772Z 2024-05-02 12:56:42 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:42 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:42 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:42 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:44 DEBUG    ReqId 140062230570752 Waiting for title (attempt 16): Just a moment...
2024-05-02 12:56:46 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:46.033274371Z 2024-05-02 12:56:46 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:46 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:46 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:46 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:48 DEBUG    ReqId 140062230570752 Waiting for title (attempt 17): Just a moment...
2024-05-02 12:56:49 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:49.331896461Z 2024-05-02 12:56:49 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:49 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:49 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:49 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:51 DEBUG    ReqId 140062230570752 Waiting for title (attempt 18): Just a moment...
2024-05-02 12:56:52 DEBUG    ReqId 140062230570752 Timeout waiting for selector
2024-05-02T12:56:52.605928046Z 2024-05-02 12:56:52 DEBUG    ReqId 140062230570752 Try to find the Cloudflare verify checkbox...
2024-05-02 12:56:52 DEBUG    ReqId 140062230570752 Cloudflare verify checkbox not found on the page.
2024-05-02 12:56:52 DEBUG    ReqId 140062230570752 Try to find the Cloudflare 'Verify you are human' button...
2024-05-02 12:56:52 DEBUG    ReqId 140062230570752 The Cloudflare 'Verify you are human' button not found on the page.
2024-05-02 12:56:53 DEBUG    ReqId 140062470235904 A used instance of webdriver has been destroyed
2024-05-02T12:56:53.103475192Z 2024-05-02 12:56:53 ERROR    ReqId 140062470235904 Error: Error solving the challenge. Timeout after 60.0 seconds.
2024-05-02 12:56:53 DEBUG    ReqId 140062470235904 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 60.0 seconds.', 'startTimestamp': 1714654552158, 'endTimestamp': 1714654613103, 'version': '3.3.17'}
2024-05-02T12:56:53.103858257Z 2024-05-02 12:56:53 INFO     ReqId 140062470235904 Response in 60.945 s
2024-05-02T12:56:53.104445431Z 2024-05-02 12:56:53 INFO     ReqId 140062470235904 162.158.110.152 POST https://xxxxxx.xxx.xxx/v1 500 Internal Server Error

Screenshots

No screenshot available.

CyberPoison commented 1 month ago

Not sure if related with: https://github.com/FlareSolverr/FlareSolverr/issues/1036

Maybe some managers of this repo is able to tell me if if it's the same issue 🤔

CyberPoison commented 1 month ago

Also, if there is a chance there is a way to add a github action to build and package the code in docker + push the package to docker hub to be able to get the image on docker builded after every push on this repo ? Like in a dev image tag

Or at least a cron to build it ?