smartchicago / chicagoworksforyou

A citywide dashboard with ward-by-ward views of service delivery in Chicago. Includes complete API. Built using Chicago Open311 data.
http://www.chicagoworksforyou.com
MIT License
17 stars 6 forks source link

API is borked? #186

Closed santheo closed 11 years ago

santheo commented 11 years ago

http://cwfy-api-staging.smartchicagoapps.org/requests/counts_by_day.json?day=2013-07-21 returns:

Error 503 Service Unavailable

Service Unavailable

Guru Meditation:

XID: 1165362188

Varnish cache server
santheo commented 11 years ago

Can you look into this today before the meeting?

santheo commented 11 years ago

Oh, it appears to be back, but maybe the worker was broken? Latest day is empty:

http://cwfy-staging.smartchicagoapps.org/#/

cgansen commented 11 years ago

Server's hard drive is full. I will resize it.

On Wed, Aug 7, 2013 at 10:09 AM, Sandor Weisz notifications@github.comwrote:

Oh, it appears to be back, but maybe the worker was broken? Latest day is empty:

http://cwfy-staging.smartchicagoapps.org/#/

— Reply to this email directly or view it on GitHubhttps://github.com/smartchicago/chicagoworksforyou/issues/186#issuecomment-22258146 .

cgansen@cct.org

cgansen commented 11 years ago

New SR are flowing in. We'll need to refetch all the data from July 31 - today, since it was all lost. I'll also add some alerting so this doesn't catch us by surprise in the future.

santheo commented 11 years ago

bustedtees 71e92c2f-8d56-44f6-aa03-e37740d4

cgansen commented 11 years ago

Resized the machine to a m1.medium, resized the server's HDD to 32GB, and New Relic is now monitoring free space.