ESA-APEx / apex_algorithms

Hosted APEx algorithms
Apache License 2.0
0 stars 0 forks source link

Set up initial benchmark for worldcereal #4

Closed JeroenVerstraelen closed 3 months ago

JeroenVerstraelen commented 3 months ago

A simple initial benchmark workflow using the worldcereal scenario. No regression test, no metrics

Github action, doesn't have to be recurrent yet.

soxofaan commented 3 months ago

initial setup is done

soxofaan commented 3 months ago

First benchmark batch job is now running, fully triggered from GitHub workflow:

j-24062104655b4a8d91b124f13a3b625f from workflow https://github.com/ESA-APEx/apex_algorithms/actions/runs/9616807287

soxofaan commented 3 months ago

So the basics are in place now.

Quite some further finetuning and documentation to be covered (see TODO comments in the code)

soxofaan commented 3 months ago

because the worldcereal use case is still failing, I now added a very simple max NDVI UDP and benchmark scenario which now successfully runs in the benchmark workflow

soxofaan commented 3 months ago

Initial benchmark setup, with a daily run can be checked at https://github.com/ESA-APEx/apex_algorithms/actions/workflows/benchmarks.yaml

note that it sometimes works, and sometimes fails, but that is indication that the benchmark system works: one benchmark scenario (max_ndvi) finishes, while the worldcereal one does not work yet

soxofaan commented 3 months ago

I think it's time to close this one: basics are in place, and follow-up tickets are created, e.g.: