code-for-venezuela / c4v-py

3 stars 3 forks source link

Add TweetLoader Class #31

Closed dieko95 closed 4 years ago

dieko95 commented 4 years ago
As a user, I want to use a method to query `angostura.tweets` 
by batch size and batch number,
and have as output these tweets as `tf.dataset` type. 

About this Class

This class is an abstraction of AngosturaConnection. The method is to be implemented it as a generator. The user just uses it in a for loop.

Purpose

Perform query paging to return batches of tweets that will be consumed the vocabulary modules.

Parameters

Returns

Tasks