Lostfilm.tv cloudflare problem

Anorov / cloudflare-scrape

A Python module to bypass Cloudflare's anti-bot page.

MIT License

3.4k stars 462 forks source link

cfscrape version number

Run pip show cfscrape and paste the output below:

Name: cfscrape Version: 2.1.1 Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information. Home-page: https://github.com/Anorov/cloudflare-scrape Author: Anorov Author-email: anorov.vorona@gmail.com License: UNKNOWN Location: /usr/local/lib/python3.8/dist-packages Requires: requests Required-by:

Complete exception and traceback

(If the problem doesn't involve an exception being raised, leave this blank)

Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 251, in solve_challenge challenge, ms = re.search( AttributeError: 'NoneType' object has no attribute 'groups' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "test.py", line 4, in <module> print (scraper.get("https://www.lostfilm.tv/v_search.php?a=583001008").content) File "/usr/lib/python3/dist-packages/requests/sessions.py", line 546, in get return self.request('GET', url, **kwargs) File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 129, in request resp = self.solve_cf_challenge(resp, **kwargs) File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 204, in solve_cf_challenge answer, delay = self.solve_challenge(body, domain) File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 290, in solve_challenge raise ValueError( ValueError: Unable to identify Cloudflare IUAM Javascript on website. Cloudflare may have changed their technique, or there may be a bug in the script. Please read https://github.com/Anorov/cloudflare-scrape#updates, then file a bug report at https://github.com/Anorov/cloudflare-scrape/issues."

Before creating an issue, first upgrade cfscrape with pip install -U cfscrape and see if you're still experiencing the problem. Please also confirm your Node version (node --version or nodejs --version) is version 10 or higher.

Make sure the website you're having issues with is actually using anti-bot protection by Cloudflare and not a competitor like Imperva Incapsula or Sucuri. And if you're using an anonymizing proxy, a VPN, or Tor, Cloudflare often flags those IPs and may block you or present you with a captcha as a result.

Please confirm the following statements and check the boxes before creating an issue:

[x] I've upgraded cfscrape with pip install -U cfscrape

[x] I'm using Node version 10 or higher

[x] The site protection I'm having issues with is from Cloudflare

[x] I'm not using Tor, a VPN, or an anonymizing proxy

Python version number

Run python --version and paste the output below:
Python 3.8.5
cfscrape version number

Run pip show cfscrape and paste the output below:
Name: cfscrape
Version: 2.1.1
Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information.
Home-page: https://github.com/Anorov/cloudflare-scrape
Author: Anorov
Author-email: anorov.vorona@gmail.com
License: UNKNOWN
Location: /usr/local/lib/python3.8/dist-packages
Requires: requests
Required-by:
Code snippet involved with the issue
import cfscrape
scraper = cfscrape.create_scraper()       
print (scraper.get("https://www.lostfilm.tv/v_search.php?a=583001008").content)
Complete exception and traceback

(If the problem doesn't involve an exception being raised, leave this blank)
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 251, in solve_challenge
    challenge, ms = re.search(
AttributeError: 'NoneType' object has no attribute 'groups'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "test.py", line 4, in <module>
    print (scraper.get("https://www.lostfilm.tv/v_search.php?a=583001008").content)
  File "/usr/lib/python3/dist-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 129, in request
    resp = self.solve_cf_challenge(resp, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 204, in solve_cf_challenge
    answer, delay = self.solve_challenge(body, domain)
  File "/usr/local/lib/python3.8/dist-packages/cfscrape/__init__.py", line 290, in solve_challenge
    raise ValueError(
ValueError: Unable to identify Cloudflare IUAM Javascript on website. Cloudflare may have changed their technique, or there may be a bug in the script.

Please read https://github.com/Anorov/cloudflare-scrape#updates, then file a bug report at https://github.com/Anorov/cloudflare-scrape/issues."
URL of the Cloudflare-protected page

https://www.lostfilm.tv/v_search.php?a=583001008

URL of Pastebin/Gist with HTML source of protected page

https://www.lostfilm.tv/v_search.php?a=583001008

cfscrape and https://github.com/VeNoMouS/cloudscraper are patched, can't bypass any waf, c;loudscraper is also patched, it can't bypsas no challenge website or v1 all dead, cloudflare fucked all free libs, admins can't play with cloudflare... You can use puppeteer to bypass it

Anorov / cloudflare-scrape