Enable/Disable Auto-materialize daemon at startup from configuration or environment variable

[razafinl]

What's the use case?

When deploying new Dagster instance (as code) or promoting to new environment, we would like to be able to automatically enable auto-materialize daemon without having to log into the UI and manually enable it.

Ideas of implementation

An additional configuration field could be provided in dagster.yaml in order to enable auto-materialize at start-up if its status has never been changed yet.

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

[hunsbea]

As someone new to Dagster, I would have assumed everything could be enabled automatically either via definitions, configuration, or at least an API call. For example, I see schedules can be automatically enabled via default_status=DefaultScheduleStatus.RUNNING so allowing auto-materilization by default seems like a no-brainer. Anyway that's a long-winded way of saying "+1"

[sryza]

This is now possible by setting the following in your dagster.yaml:

auto_materialize:
    enabled: True

[sryza]

Sorry folks - it looks like I actually misunderstood the behavior of the aforementioned config param and this functionality is not yet present :(. Reopening this.

[sryza]

However, we are currently working on changes that will make this possible in a not-far-away release

[cyberjar09]

to tag onto this request, can we also make the frequency configurable? in my case, due to the sheer number of assets, the evaluation takes on average 1-2 mins. I dont see the need for auto-materialise to run every minute. I'd prefer to just do it every 5 mins (for example) 😄