search

axheron / ffxiv-dps-calc

A Final Fantasy XIV DPS simulator for comparing gear sets
https://dpscalc.xivresources.com
GNU Affero General Public License v3.0
2 stars 4 forks source link

Pull in data from xivapi instead of having hardcoded things #45

Open ackao opened 3 years ago

ackao commented 3 years ago

Daily(?) fetch, store in DB so that we don't suffer as much when new patches hit

Monitor for consecutive fetch failures

axheron commented 3 years ago

What data would this need? xivapi updates are rare so it might be better to use Lumina or something to generate a JSON bundle we can package. Scraping of xivapi is also bannable so better to avoid it if we can unless the data is small or something we can cache on demand.

ackao commented 3 years ago

this was a thing ackwell mentioned to me when i talked about this project w/ him

specifically he linked me this: https://xivapi.com/classjob/28

but yeah he also mentioned lumina.

you probably know better than i do about what the options are, but basically the goal of this was to reduce toil by automatically pulling in numbers updates when new patches hit. i originally suggested daily fetch in this issue because i didn't think requesting a webpage once a day would be objectionable and that would save braincells of having to manually run, but if all scraping is banned then rip.