search

qurator-spk / eynollah

Document Layout Analysis
Apache License 2.0
328 stars 26 forks source link

CI: How to invalidate cache? #98

Closed kba closed 1 year ago

kba commented 1 year ago

In CircleCI, the python 3.8 builds fail because (I think) the models are cached and now outdated -> bad marshal error solved by #91.

Currently, the cache key is the static string model-cache, i.e. it will never be invalidated. Maybe it should be something like model-cache-<< pipeline.git.branch >>.

cneud commented 1 year ago

I got the cache updated, but now the smoke-test fails due to RAM exhaustion - the Docker executor on CircleCI only has only 4 GB. We could maybe switch to using the machine executor (e.g. ubuntu-2004) which is supposed to have 8 GB.

cneud commented 1 year ago

I had to set the Python version in the machine executor explictely via pyenv, but now the smoke-test passes!

We're all green both on GitHub Actions and CircleCI now for eynollah_light with Python 3.7 & 3.8 🍾