search

shaikhsajid1111 / twitter-scraper-selenium

Python's package to scrap Twitter's front-end easily
https://pypi.org/project/twitter-scraper-selenium
MIT License
305 stars 47 forks source link

"Tweets did not appear!" #23

Open rilakkuromi opened 2 years ago

rilakkuromi commented 2 years ago

Code scrap_keyword(keyword="nft", browser="chrome", tweets_count=999999, until="2022-06-30", since="2022-06-29",output_format="csv",filename="nft")

Error Message [WDM] - Current google-chrome version is 103.0.5060 [WDM] - Get LATEST driver version for 103.0.5060

[WDM] - Driver [./.wdm/drivers/chromedriver/mac64/103.0.5060.53/chromedriver] found in cache Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear! Tweets did not appear!

Other Infomation requirement.txt has already been installed

Screenshot 2022-06-28 at 1 52 17 PM
shaikhsajid1111 commented 2 years ago

Okay, I will look into this issue

shaikhsajid1111 commented 2 years ago

The number of tweets you're scraping might be the issue. I'm unable to recreate the same scenario but it is evident when you scroll too many tweets, Twitter redirects you to the login page. I assume after scrolling for around 100-200 tweets Twitter is redirecting you to the login page which leads to this error that the crawler couldn't find the tweets.

elightcap commented 1 year ago

i occasionally have this issue with scrape_profile. im only looking at the 2 most recent tweets, and checking in every 5 minutes