New data interface ingest

nsidc / snow-today-webapp-server

Serve data the snow-today-webapp depends on

https://snow-today-webapp-server.readthedocs.io/

MIT License

4 stars 0 forks source link

New data interface ingest #46

Closed mfisher87 closed 8 months ago

mfisher87 commented 9 months ago

@sebastien-lenard I found a mistake with the relative paths in our example data: https://github.com/nsidc/snow-today-webapp-server/commit/bda9e402ab8244393e6a5747cd9ee1a50641d2c3

Can you double-check the supercomputer source code reflects these changes?

sebastien-lenard commented 9 months ago

Actually it's "shapes/11725.geojson" in the current code. So i forgot updating the example data . Should i update the code so that it's "regions/shapes/11725.geojson"?

mfisher87 commented 9 months ago

Should i update the code so that it's "regions/shapes/11725.geojson"?

Yes please, but shouldn't it be regions/shapes/11/11725.geojson?

mfisher87 commented 9 months ago

Both SWE and SSP ingests working. Left TODO:

[x] Fix Mypy complaints
[ ] Clean up TODOs
[ ] Clean up orphaned typedefs, utility funcs, etc.
[x] Add new Pydantic models, and from those generate the JSON schemas for validation.
- [x] How will the docs that display schemas be impacted? Should we run some Python in Quarto to generate the schemas from the Pydantic models? Or should we add scripts to generate the schemas solely as reference documents and add CI automation that checks the schemas are up-to-date with the models?