search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
10.72k stars 1.33k forks source link

Allow defining custom Pythonic config type #19329

Open benpankow opened 5 months ago

benpankow commented 5 months ago

What's the use case?

Build a way to allow custom config types which serialilze/deserialize into one of our supported underlying config types (str, int, etc). For example, a date config type which accepts a string input in the Launchpad but which provides op/asset code with a datetime object.

Ideas of implementation

No response

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

cdchan commented 3 months ago

This would good for use cases like https://github.com/dagster-io/dagster/discussions/19033

In my case, I could make a custom config type that retrieves secrets from Google Secret Manager, but is recognized as a str like EnvVar