search

twintproject / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
MIT License
15.75k stars 2.72k forks source link

Can i collect tweets together with its user info?How to include cashhag in the search? #691

Open Cheryl520 opened 4 years ago

Cheryl520 commented 4 years ago

When I use .Search to scrape the tweets, can I get the information of the user who post this tweet together with the tweet post in the same row? the information of the user includes 'verified or not', 'number of followers', 'number of followings', etc.

Moreover, im trying to only collect tweets with cashtags. I type this in my terminal:

for i in ‘$BRK’ ‘$BRKB’
do
twint -s $i --since 2018-01-20 --until 2018-01-27 --hashtags --lang en -o test_$i.csv --csv
done

it only output tweets between 2018-01-25 and 2018-01-26, having other days missing, while if i only search for BRK without $, it will not have this problem. I checked in the BRK file and filtered with $, there're tweets containing $BRK all the way since 2018-01-20 until 2018-01-27. I don't know why this will happen.

Thanks in advance!

pielco11 commented 4 years ago

It seems that Twitter does not handle requests for cashtags, they simply return a message containing "something went wrong". Maybe The request's URL needs to be tuned.

Also it's not possible to get the information about the users that posted tweets at the same time that you get those. You have to first get the tweets and then, for each user, get the info