search

PDHdata / SmallFormats

Deck-stats server for less-common Magic: the Gathering formats
MIT License
6 stars 0 forks source link

Need to automate daily crawling #5

Closed vtbassmatt closed 1 year ago

vtbassmatt commented 2 years ago

SSHing into production daily is not going to be sustainable.

vtbassmatt commented 1 year ago

Web-based crawling for decks gets us part of the way there. Scryfall fetcher still isn't incremental enough.

vtbassmatt commented 1 year ago

See https://fly.io/docs/app-guides/supercronic/ and https://github.com/aptible/supercronic

vtbassmatt commented 1 year ago

We have supercronic now! Fetching cards is automated (at 3am UTC daily), next will be hardening the crawlers a bit more and adding them to the script.

vtbassmatt commented 1 year ago

Fixed in next deployment. Opened https://github.com/PDHdata/SmallFormats/issues/40 to track future removal of web version.