set the JOB_RUNNER environment variable to kubernetes
setup the S3 file storage
setup a local cluster (with kind or Docker Desktop)
have the API accessible from the cluster (in my case, I set the BASE_URL and the VUE_APP_API_URL to my local IP)
create a runner-env secret in the current namespace with the following variables:
AWS_ACCESS_KEY_ID=XXX
AWS_SECRET_ACCESS_KEY=XXX
S3_ENDPOINT=XXX
GRAPH_STORE_ENDPOINT=XXX # should also be accessible from within the cluster
GRAPH_STORE_USER=
GRAPH_STORE_PASSWORD=
Create it like this: kubectl create secret generic --from-env-file FILE runner-env
When running a job, you should have a datacube-runner-XXX job created as well as a datacube-runner-XXX-YYYY pod spawned.
How to try this:
JOB_RUNNERenvironment variable tokuberneteskindor Docker Desktop)BASE_URLand theVUE_APP_API_URLto my local IP)runner-envsecret in the current namespace with the following variables:Create it like this:
kubectl create secret generic --from-env-file FILE runner-envWhen running a job, you should have a
datacube-runner-XXXjob created as well as adatacube-runner-XXX-YYYYpod spawned.