search

cartfisk / chicken-parse

retrieve mentions, hashtags & URLs from tweets
1 stars 0 forks source link

Role of component in product? #2

Open jthompson18 opened 8 years ago

jthompson18 commented 8 years ago

@cartfisk I was impressed with what you got done for the project. It is well structured and well tested. The Tweet container was a good idea.

I've got a few thought provoking questions for you. Where would you see your tweet parser living in a complete product? What would the purpose of the tweet container be in a complete project? I could see it streamlining a batch insert of some sort when persisting the tweets.

cartfisk commented 8 years ago

The only form of raw Twitter data I've seen is the personal archives it lets you download. I see it as a piece of a tool that will take in a BUNCH of tweets and spit out metrics of "how many Tweets in group A contain data item B". Could be used to generate something like word clouds or determine effectiveness of hashtags.

So yes, I think it would be part of a tool that manipulates large batches of Tweets and generates useful data from them.