search

Code4HR / open-health-inspection-scraper

Scraper for the open-health-inspector app.
Apache License 2.0
7 stars 9 forks source link

Mongo Database Down #25

Closed qwo closed 10 years ago

qwo commented 10 years ago

No vendors found, also connecting by shell or RoboMongo shows inability to connect

http://api.openhealthinspection.com/vendors?city=norfolk

edit:must be in the middle of a scrape?

wbprice commented 10 years ago

Worth noting that we have a backup from yesterday available here: http://api.openhealthinspection.com/bulk/

If this is an issue of the scraper dropping the database and rebuilding, would be worthwhile to temporarily switch over to this if possible.

ttavenner commented 10 years ago

Sorry, I was away from my computer all of today. This is not a scraper issue. It hasn't run since yesterday. For some reason the mongolab db is down or gone. I'm not sure. I don't have the mongolab login information, I only have authentication info for the database itself. In any case I set up a local mongodb with the bulk file from yesterday. There does appear to be some missing data so I will probably need to run the scraper again to make sure everything is in shape, but in the meantime we have the majority of data and the app is up and running again.

qwo commented 10 years ago

:thumbsup:

wbprice commented 10 years ago

Would it be worthwhile to migrate the Mongo DB to Digital Ocean using our credits?

ttavenner commented 10 years ago

We should talk about infrastructure again at hack night and define a more sustainable plan in general. Preferably one where @BretFisher is around. I can host the DB for now but if we go with a centralized server setup using Jenkins or Travis to handle deployment the database could come along with it.

BretFisher commented 10 years ago

For prod it would be easier if we used a Mongo PaaS rather then roll our own, unless we thought we would end up with really big or lots of DB’s.

and 2nd thought is “it’s not a terrible big deal” to run our own beefy mongodb instance for all projects if that became our no-sql of choice. I’ve run several prod mongo replica clusters on ubuntu for a few years and understand the basics of admin, backups, and upgrading. Lets talk about our options this week at hacknight…. “data storage throw down” :)

On Mon, Sep 1, 2014 at 9:17 PM, Tommy Tavenner notifications@github.com wrote:

We should talk about infrastructure again at hack night and define a more sustainable plan in general. Preferably one where @BretFisher https://github.com/BretFisher is around. I can host the DB for now but if we go with a centralized server setup using Jenkins or Travis to handle deployment the database could come along with it.

— Reply to this email directly or view it on GitHub https://github.com/c4hrva/open-health-inspection-scraper/issues/25#issuecomment-54100693 .