casmlab / stack

The BITS Lab STACK tool for social media collection and analysis.
http://bits.ischool.syr.edu/
MIT License
1 stars 0 forks source link

Term summary stats #8

Closed libbyh closed 7 years ago

libbyh commented 7 years ago

For each term, display the following info:

  1. Total number of Tweets per day, per week, per month -can we track time of the day tweets?
  2. Number of tweets that have photographs
  3. Number of tweets that have videos
  4. Number of tweets with hashtags
  5. Number of tweets that are RTs of other tweets
  6. Number of tweets with exclamation point!
  7. Number of tweets using ALL CAPS for some words
  8. Number of tweets with profanity
  9. How many followers over time
pratik27shah commented 7 years ago

Total URLS: Total Tweets with Hashtags: Total Tweets with exclamation : Total Tweets with User mentions : Total Tweets with Re-tweeted : this values are being displayed now...

pratik27shah commented 7 years ago

Total URLS: Total Tweets with Hashtags: Total Tweets with exclamation : Total Tweets with User mentions : Total Tweets with Re-tweeted : this values are being displayed now... is this ok??

pratik27shah commented 7 years ago

working on the feature for faster lookup in case when there is alot of data

libbyh commented 7 years ago

These look ok. We're missing a "Total tweets in database" count - that was my oversight. Also, how does user get back to this view once a user clicks "View Content"?

libbyh commented 7 years ago

These don't show up for terms in the potus45 collector. Is it just that there are millions of tweets taking too long?

libbyh commented 7 years ago

Figured out the problem - it's calculating all these stats for every tweet in the collector and should calculate for just those tweets authored by the "term".

pratik27shah commented 7 years ago

as per discussion