Open chrisnguyn opened 2 years ago
scraping is dumb. like, really dumb
it's slow, what if no internet connection, so many repeatedly calls and for what?
data mining - scraping + storing into a DB - doesn't seem that great either. a lot of DB calls + latency + slow in general
static JSON files is prob the way to go (the data never needs to be updated, if it was more dynamic then maybe DB calls is better)
also next time you decide to develop an API, plan it beforehand, because /man/ once you make an API it's hard to revert on it.
scraping is dumb. like, really dumb
it's slow, what if no internet connection, so many repeatedly calls and for what?
data mining - scraping + storing into a DB - doesn't seem that great either. a lot of DB calls + latency + slow in general
static JSON files is prob the way to go (the data never needs to be updated, if it was more dynamic then maybe DB calls is better)
also next time you decide to develop an API, plan it beforehand, because /man/ once you make an API it's hard to revert on it.