sunscreem / dogpubtimemachine

An open source project to quickly show what Brewdog bars have had on tap.
https://dogpubtimemachine.com/
MIT License
4 stars 1 forks source link

How do we handle a bar that has an issue and stops reporting in? #37

Open sunscreem opened 6 years ago

sunscreem commented 6 years ago

Do we give them a while and then remove their beers?

billythekid commented 6 years ago

How often are you running the spiders? are all bars polled on a daily basis?

Since the time machine part of this is daily, I'd suggest that if a bar has not reported on that day that it's removed. HOWEVER - what if they just happen to have the same beers on as the day before so don't need to change anything? They probably don't report in then.

sunscreem commented 6 years ago

I scrape every 1 hours ish (58 bars - one bar checked every 2 minutes). And yeah - there are bars that only change beers once a week (Overworks for example). I'll come up with some more examples... that'll help.