Closed JeroenVerstraelen closed 3 months ago
initial setup is done
First benchmark batch job is now running, fully triggered from GitHub workflow:
j-24062104655b4a8d91b124f13a3b625f
from workflow https://github.com/ESA-APEx/apex_algorithms/actions/runs/9616807287
So the basics are in place now.
Quite some further finetuning and documentation to be covered (see TODO
comments in the code)
because the worldcereal use case is still failing, I now added a very simple max NDVI UDP and benchmark scenario which now successfully runs in the benchmark workflow
Initial benchmark setup, with a daily run can be checked at https://github.com/ESA-APEx/apex_algorithms/actions/workflows/benchmarks.yaml
note that it sometimes works, and sometimes fails, but that is indication that the benchmark system works: one benchmark scenario (max_ndvi) finishes, while the worldcereal one does not work yet
I think it's time to close this one: basics are in place, and follow-up tickets are created, e.g.:
A simple initial benchmark workflow using the worldcereal scenario. No regression test, no metrics
Github action, doesn't have to be recurrent yet.