search

bwbaugh / twitter-corpus

Collects all tweets from the sample Public stream using Twitter's streaming API, and saves them to a file for later use as a corpus.
Other
46 stars 8 forks source link

Add option to rotate the corpus file based on time or size #3

Closed bwbaugh closed 8 years ago

bwbaugh commented 11 years ago

Instead of appending to the same file to store all of the tweets, it might be helpful to allow the user to choose if they want to rotate the file after a certain time (hourly, daily), or after the file reaches a certain size or number of tweets.

bwbaugh commented 8 years ago

Though this would be nice, there are other tools out there that can probably do this better without having to reimplement it here. For example, we could output to stdout and let another program deal with the file logging