search

bisguzar / twitter-scraper

Scrape the Twitter Frontend API without authentication.
MIT License
3.88k stars 600 forks source link

Hello, I cannot access more than 200-800 tweets #139

Open shreyaskorad opened 4 years ago

shreyaskorad commented 4 years ago

Hi,

I'm just learning how to data science. I don't have much experience nor expertise here. I don't even know if this is the right forum. Anyways, I thought of asking this here.

I'm doing this, but it's not exporting more than 200-800 tweets, where could i be possibly going wrong?

for tweet in get_tweets('shreyaskorad', pages=30): empty_dict = {'name': tweet['username'], 'content': tweet['text']} df = pd.DataFrame.from_dict(empty_dict, orient='index') df = df.T print(df.to_csv(r'/Users/apple/Documents/u3.csv',mode='a',header=False, index = False))

Thanks in Advance, your patience is appreciated.

caiomarcos commented 4 years ago

I have the same problem, keep getting 812 tweets.

ljocampo commented 3 years ago

Facing the same issue, no matter how big pages is set.