search

crock / disboard-scraper

Scrape Disboard.org
MIT License
2 stars 0 forks source link

Nonetype error #1

Open FeelsBadMan1 opened 3 years ago

FeelsBadMan1 commented 3 years ago

Hello, i ran the tool and then this error appeard and i changed nothing on the script:

Total Sites: 1
disboard
Traceback (most recent call last):
  File "D:\my_python_projects\Disboard scraper\github versions\1\disboard-scraper-main\main.py", line 25, in <module>
    numPagesText = soup.find(class_="listing-summary").get_text() # Showing 1 - 24 of 926745 servers
AttributeError: 'NoneType' object has no attribute 'get_text'
vavavr00m commented 2 years ago

I got the same error. Any fix?

schimmelcoding commented 2 years ago

The issue appears to be that disboard is blocking the request, if you look at data/raw/disboard.html you can find this text "disboard.org needs to review the security of your connection before proceeding."