Open multimeric opened 2 years ago
Hi @multimeric thanks for filing the issue. I believe this is related to https://github.com/dagster-io/dagster/issues/4451. cc @dpeng817 to confirm if this is still a failure condition in newer versions.
Hey @multimeric, thanks for raising. Can confirm that this is still a failure condition as of 0.14.6. Until #4451 is solved, we'll still need to error, but I think the error message could be a good deal more clear. The culprit is https://github.com/dagster-io/dagster/blob/9444b2fc8458131f2fdb95971bf6c8c6929915c2/python_modules/dagster/dagster/core/execution/plan/plan.py#L717. cc @alangenfeld , I'm wondering if this is a callsite that we just forgot to update when collect functionality was added, and memoization is hitting it earlier than everything else?
Summary
An error is encountered when trying to cache a dynamic output using
SourceHashVersionStrategy
Reproduction
Additional Info
I guess this relates to #4451, but I wanted to test if this is still a bug since the new major version.
Note that as soon as you remove the
version_strategy
argument, this worksDagit UI/UX Issue Screenshots
Additional Info about Your Environment
Message from the maintainers:
Impacted by this bug? Give it a 👍. We factor engagement into prioritization.