Logging and Dashboard - Githubissues

ActoKids / AD440_W19_CloudPracticum

3 stars 1 forks source link

Logging and Dashboard #73

Open mrvirus9898 opened 5 years ago

mrvirus9898 commented 5 years ago

As our functions roll out, they will be logging data to cloudwatch. We will need a way to access that data without digging through AWS's interface. Furthermore, you will monitor the dashboard to ensure that the lambdas are executing when they are supposed to, and are not burning through resources.

Please indicate the time spent on this, any issues that you are having, any good references you found for this subject, and credit anyone helped you out.

daonguyen81 commented 5 years ago

Time spent: 18 hrs Logging is implemented on all crawlers. Dashboard is not ready because some of the crawlers are still having issue deploying to AWS. I spent the last 5 days trying to get the OFA crawler to deploy to AWS but ran into issue with the Chrome driver permissions.

daonguyen81 commented 5 years ago

Crawlers Dashboard is finally setup for 2 Lambda functions

The first lambda function is to trigger the EC2 to run both ofa and sss script.
The secound lambda function is for the Google Canlendar.

daonguyen81 commented 5 years ago

Wiki Spent 3 more hours to research and setup this dashboard and logging.

daonguyen81 commented 5 years ago

Dashboard final configuration for Google Calendar, OutdoorForAll and Shadow Seals https://console.aws.amazon.com/cloudwatch/home?region=us-east-1#dashboards:name=Crawler-s-Dashboard