Closed cmbrennan002 closed 9 months ago
@india-kerle thanks heaps for the thoughtful PR! I've addressed most comments (agreed with all your structural suggestions) and flagged a few functions to leave for now. I've tested it runs on my machine, but given we've shifted a few things around, would really appreciate it if you could re-test on yours. Then let me know and will merge :)
cool! Will take a look now :) @cmbrennan002
ran like a dream! feel free to merge @cmbrennan002
Description
This takes code to search twitter from the repo asf_online_data_exploration
Fixes # (issue) 01
Instructions for Reviewer
You will need to add the access token to your .env file - will send to you separately
Then, you can run:
cd pipeline python recent_search_twitter.py
Based on current search parameters, that should take 10 tweets (the min number we can search for) that have come from betway and contain the word 'promotion' in the last seven days, and add it to the json file stored in the s3 bucket.