Do not show internal error when site is loading.

[deanchen]

It is being cached by varnish, throw a 503 with a nice message saying it'll be back shortly.

[grivkees]

how to on custom heroku error messages https://devcenter.heroku.com/articles/custom_error_pages