gt-big-data / retina-crawler

A news crawler for the Retina Project
8 stars 5 forks source link

Deal with while True loop in main.py. #16

Open supersam654 opened 9 years ago

supersam654 commented 9 years ago

Currently, as a fail safe, main.py wraps the crawling code in an additional while True loop (as a form of accidental exception handling). We should add appropriate try catch blocks so that overarching loop isn't necessary.

pviolette3 commented 9 years ago

to achieve this goal we'll also want to analyze log files. logs are a good indicator of things that are crashing the app.