earthcube / scheduler

Scheduling approaches related to gleaner tooling
Apache License 2.0
0 stars 0 forks source link

gleaner runs still require configs with all source names #106

Open valentinedwv opened 1 month ago

valentinedwv commented 1 month ago

docker configs are used by the gleanerio containers

Even though we now allow for a source to be added to a file in s3, this code still require that a source is in the config file

I tried a minimal file with just one source, and got: {"file":"/home/runner/work/gleaner/gleaner/cmd/gleaner/main.go:127","func":"main.main","level":"error","msg":"CAUTION: no matching source, did your -source VALUE match a sources.name VALUE in your config file?","time":"2024-06-07T15:05:07Z"}

so, need code that syncs configs with s3 when changed... this could be an issue if a config is in use so we might need to modify the stack env variables,