Open sunscreem opened 6 years ago
How often are you running the spiders? are all bars polled on a daily basis?
Since the time machine part of this is daily, I'd suggest that if a bar has not reported on that day that it's removed. HOWEVER - what if they just happen to have the same beers on as the day before so don't need to change anything? They probably don't report in then.
I scrape every 1 hours ish (58 bars - one bar checked every 2 minutes). And yeah - there are bars that only change beers once a week (Overworks for example). I'll come up with some more examples... that'll help.
Do we give them a while and then remove their beers?