Implement rotating logs

CivicTechTO / ttc_subway_times

A scraper to grab and publish TTC subway arrival times.

GNU General Public License v3.0

40 stars 30 forks source link

Implement rotating logs #23

Closed radumas closed 5 years ago

radumas commented 6 years ago

logfile got really biiig and seems to have frozen the EC2 :confused:

radumas commented 6 years ago

Also, some kind of email alert when the scraper fails hard. The RDS filled up and I think we lost a month of data :'(

jtloong commented 6 years ago

How often does it crash? You can use Mailgun which has an easy to implement Python API where you can send 10k emails per month for free. I've used it a bunch of times for different projects and its easy to use.

I can implement this sometimes this week if you're interested.