[ui] Improved performance of the Automation history view for partitioned assets
[ui] You can now delete dynamic partitions for an asset from the ui
[dagster-sdf] Added support for quoted table identifiers (Thanks, @akbog!)
[dagster-openai] Add additional configuration options for the OpenAIResource (Thanks, @chasleslr!)
[dagster-fivetran] Fivetran assets now have relation identifier metadata.
Bugfixes
[ui] Fixed a collection of broken links pointing to renamed Declarative Automation pages.
[dagster-dbt] Fixed issue preventing usage of MultiPartitionMapping with @dbt_assets (Thanks, @arookieds!)
[dagster-azure] Fixed issue that would cause an error when configuring an AzureBlobComputeLogManager without a secret_key (Thanks, @ion-elgreco and @HynekBlaha!)
Documentation
Added API docs for AutomationCondition and associated static constructors.
[dagster-deltalake] Corrected some typos in the integration reference (Thanks, @dargmuesli!)
[dagster-aws] Added API docs for the new PipesCloudWatchMessageReader
1.8.1 (core) / 0.24.1 (libraries)
New
If the sensor daemon fails while submitting runs, it will now checkpoint its progress and attempt to submit the remaining runs on the next evaluation.
build_op_context and build_asset_context now accepts a run_tags argument.
Nested partially configured resources can now be used outside of Definitions.
[ui] Replaced GraphQL Explorer with GraphiQL.
[ui] The run timeline can now be grouped by job or by automation.
[ui] For users in the experimental navigation flag, schedules and sensors are now in a single merged automations table.
[ui] Logs can now be filtered by metadata keys and values.
[ui] Logs for RUN_CANCELED events now display relevant error messages.
[dagster-aws] The new PipesCloudWatchMessageReader can consume logs from CloudWatch as pipes messages.
[dagster-aws] Glue jobs launched via pipes can be automatically canceled if Dagster receives a termination signal.
[dagster-azure] AzureBlobComputeLogManager now supports service principals, thanks @ion-elgreco!
[dagster-databricks] dagster-databricks now supports databricks-sdk<=0.17.0.
[dagster-datahub] dagster-datahub now allows pydantic versions below 3.0.0, thanks @kevin-longe-unmind!
[dagster-dbt] The DagsterDbtTranslator class now supports a modfiying the AutomationCondition for dbt models by overriding get_automation_condition.
[dagster-pandera] dagster-pandera now supports polars.
[dagster-sdf] Table and columns tests can now be used as asset checks.
[dagster-embedded-elt] Column metadata and lineage can be fetched on Sling assets by chaining the new replicate(...).fetch_column_metadata() method.
[dagster-embedded-elt] dlt resource docstrings will now be used to populate asset descriptions, by default.
[dagster-embedded-elt] dlt assets now generate column metadata.
[dagster-embedded-elt] dlt transformers now refer to the base resource as upstream asset.
[dagster-openai] OpenAIResource now supports organization, project and base_url for configurting the OpenAI client, thanks @chasleslr!
[dagster-pandas][dagster-pandera][dagster-wandb] These libraries no longer pin numpy<2, thanks @judahrand!
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Bumps dagster from 1.7.13 to 1.8.2.
Changelog
Sourced from dagster's changelog.
... (truncated)
Commits
28a7e19
1.8.28ca70e0
Add 1.8.2 changelog (#23810)14ad657
Revert "[single-implicit-asset-job] methods onCodeLocation
to get job part...cdb5265
Revert "[single-implicit-asset-job] addpartitionKeysOrError
and `partition...9f94d1e
Revert "[ui] Use single hidden asset job for all single-run asset executions ...67ead1c
Revert "Revert "revert single implicit asset job (#23607)" (#23777)"397567a
Revert "re-revert "removeget_implicit_job_def_for_assets
(#23372)" (#23798)"fd788c2
re-revert "removeget_implicit_job_def_for_assets
(#23372)" (#23798)bca83d4
[DA] Add doc block to AutomationCondition, mark static constructors public (#...d0422fd
Revert "revert single implicit asset job (#23607)" (#23777)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show