Closed josvandervelde closed 9 months ago
The croissants are now located at /datasets/[IIII]/[id]/dataset_[id]_croissant.json instead of /dataset_[id]/croissant.json because we don't want thousends of buckets in MinIO.
/datasets/[IIII]/[id]/dataset_[id]_croissant.json
/dataset_[id]/croissant.json
(on k8s, every 10 minutes, a job runs to add the newest croissants)
The croissants are now located at
/datasets/[IIII]/[id]/dataset_[id]_croissant.jsoninstead of/dataset_[id]/croissant.jsonbecause we don't want thousends of buckets in MinIO.(on k8s, every 10 minutes, a job runs to add the newest croissants)