banjtheman / dc_ndoch_2021

Code for DC 2021 National Day of Civic Hacking
1 stars 2 forks source link

Fetch recent 3200 dcfireems treets and filter for dispatch tweets #13

Closed jkwening closed 2 years ago

jkwening commented 2 years ago

Use Twitter timeline API to fetch most recent 3200 Tweets from dcfireems using rolling pagination calls and save raw data to file with most recent tweet ID as UIN. Then use regex to filter for dispatch tweets and save to csv with most recent timestamp as UIN. This should complete #1 but can be expanded for regular fetches to improve model building in #5 since of the last 3200 tweets, only 231 were dispatch tweets.

banjtheman commented 2 years ago

Awesome work 🥇