owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
60 stars 18 forks source link

Data API should have offline mode when working locally #2247

Open Marigold opened 5 months ago

Marigold commented 5 months ago

Our Data API, even the local one, saves files to R2. This makes our life easy in some ways (e.g. fallbacks to production API are handled by the worker and you don't need to download the entire catalog), but it's not a great dev experience if you have poor internet connection

We could add it either with:

or by rewriting endpoint /admin/api/data/variables/data/819356.json in grapher Admin and adding support for local files.

We should also have make command for fetching the entire catalog from R2 locally.

stale[bot] commented 1 month ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Marigold commented 1 month ago

Keep it open. I'll do it one day, I promise...