Now that we have the API, we may no longer need bakeries.yaml as our "database" of bakeries.
However, we need to make the distinction between two distinct needs:
Public information about the bakeries that many clients need to know. For example, a recipe meta.yaml needs to route itself to a bakery. It needs to identify the bakery by a unique name. This also includes things like bakery contacts, description, etc.
Private, internal configuration used in registering flows and within the bakery flow runs. For example:
This really doesn't feel like something that the world outside the bakery needs to care about. In addition, bakeries evidently also have environment variables which determine their config, e.g https://github.com/pangeo-forge/pangeo-forge-gcs-bakery/pull/27. So the config is spread around in multiple places. This seems fragile / hard to debug.
The challenge is that bakeries.yaml is currently storing both types of information. So I propose we separate these two categories. Stuff in category 1 needs to go into the API. Stuff in category 2 should live in a config file that is maintained by the bakery operator.
Now that we have the API, we may no longer need bakeries.yaml as our "database" of bakeries.
However, we need to make the distinction between two distinct needs:
This really doesn't feel like something that the world outside the bakery needs to care about. In addition, bakeries evidently also have environment variables which determine their config, e.g https://github.com/pangeo-forge/pangeo-forge-gcs-bakery/pull/27. So the config is spread around in multiple places. This seems fragile / hard to debug.
The challenge is that bakeries.yaml is currently storing both types of information. So I propose we separate these two categories. Stuff in category 1 needs to go into the API. Stuff in category 2 should live in a config file that is maintained by the bakery operator.