search

taspinar / twitterscraper

Scrape Twitter for Tweets
MIT License
2.4k stars 578 forks source link

Getting error with main code inside beatifulSoup #372

Open tienquyet28 opened 2 years ago

tienquyet28 commented 2 years ago

/usr/local/lib/python3.7/dist-packages/twitterscraper/query.py in get_proxies() 47 soup = BeautifulSoup(response.text, 'lxml') 48 table = soup.find('table',id='proxylisttable') ---> 49 list_tr = table.find_all('tr') 50 list_td = [elem.find_all('td') for elem in list_tr] 51 list_td = list(filter(None, list_td))

AttributeError: 'NoneType' object has no attribute 'find_all'

When I run CLI or in python It get error from BeautifulSoup lib, please help

tsp2123 commented 1 year ago

Has anyone found a solve for this?

Prit2341 commented 1 year ago

hey I know how to solve this issue I would Like to work on this

Prit2341 commented 1 year ago

D:\twitterscraper\twitterscraper>python main.py

D:\twitterscraper\twitterscraper>

I am getting this output is this right or wrong

jkahil commented 1 year ago

yes just put soup.find('table') as the table id has been dropped from the page

CryptoRahino commented 1 year ago

got hte same issue. solved this with removing ,id='proxylisttable' from table = soup.find('table',id='proxylisttable') in query.py > get_proxies()