heondo / reddit_pl

reddit pipeline practice
0 stars 0 forks source link

reddit_pl

reddit pipeline practice

practicing working with data, python, and aws services.

Make it work again with new Lambda code structure

Redid original pipeline code after becoming more familiar with objects in Python, but in turn the function stopped working when using in AWS Lambda.

Get that running again so the data is updated and inserted into S3 and DynamoDB regularly every 6 hours.

Easy to get most recent version of a post and comment and do analyses on those records.