BonfaceKilz / feedanalyser

Fetch info from public feeds
GNU General Public License v3.0
1 stars 2 forks source link

(feature) Scrape twitter feed #2

Closed BonfaceKilz closed 4 years ago

BonfaceKilz commented 4 years ago

As a scientist, I want to get tweets from a given account so that I can store them in a database later.

Feature: Scraping user tweets and storing it in Redis

Scrape feeds and turn them into an SQLite or Redis db. For this POC, start with: https://twitter.com/AbePalmer. See who he connects to and get any posts that are related to Rat Science. See if the twitter API is helpful for scraping. Also, explore other feeds on social media if relevant.

Model this problem as an aggregator.

Scenario: Twitter username is provided Given the twitter username exists and is valid When it is received Then the username's tweets are stored as x-epr in a redis database