Sustainable Data Distribution

[tgxn]

I want to publish:

• Redis data dump
• data/**.json exports

Somewhere other than Git, as they don't need long-term versioning.

I also don't really want people pulling data from CloudFront.

Currently thinking an S3 bucket for job storage, and publishing the dumps to GitHub Artifacts or Releases?

[tgxn]

Currently the data is in GitHub Releases, maybe there'd be somewhere better for it.

Ideally:

• Storage for ~30 days
• ZIP or directory with files available
• Not bound to Git Pushes - Data is updated daily

[tgxn]

for now they are on github artifacts, i think i'll have to host them in s3 in future :/