Closed dieko95 closed 4 years ago
As a user, I want to use a method to query `angostura.tweets` by batch size and batch number, and have as output these tweets as `tf.dataset` type.
This class is an abstraction of AngosturaConnection. The method is to be implemented it as a generator. The user just uses it in a for loop.
AngosturaConnection
Perform query paging to return batches of tweets that will be consumed the vocabulary modules.
TweetLoader
load_sinluz_rawtweets
batch size
batch number
tf.dataset
About this Class
This class is an abstraction of
AngosturaConnection
. The method is to be implemented it as a generator. The user just uses it in a for loop.Purpose
Perform query paging to return batches of tweets that will be consumed the vocabulary modules.
Parameters
Returns
Tasks
TweetLoader
class.AngosturaConnection
within the constructor.load_sinluz_rawtweets
method.batch size
andbatch number
to SQL query.tf.dataset
.