aai-institute / lakefs-spec

An fsspec implementation for the lakeFS project.
http://lakefs-spec.org/
Apache License 2.0
37 stars 4 forks source link

Working on docs for a longer time causes local failure of docs build because of too many requests on Weather API. #192

Closed maxmynter closed 6 months ago

maxmynter commented 7 months ago

Our recently introduced change to handle the demo notebook with Jupytext causes a run of the entire notebook on every change to the docs via the hot reloading of mkdocs serve.

Since the note book is rebuild everytime from jupytext, it is executed on every hot reload. After some time of working on the docs, the notebook execution fails because the Open Meteo API blocks too many requests. Then one can not work on the docs.

Alternatives to be considered: 1) https://jupyter-cache.readthedocs.io/en/latest/ OR 2) implement client side caching for API access.