search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
11.14k stars 1.4k forks source link

Memoization for asset jobs #8628

Open zareami10 opened 2 years ago

zareami10 commented 2 years ago

According to the documentations it is currently not possible to use memoization with asset jobs (and asset materialization in general). It would be a nice to have, e.g. via define_asset_job.

Message from the maintainers:

Excited about this feature? Give it a :thumbsup:. We factor engagement into prioritization.

dpeng817 commented 2 years ago

Linking this to a broader issue on supporting memoization for software-defined assets https://github.com/dagster-io/dagster/issues/8632