[ui] fixes behavior issues with jobs and asset pages introduced in 1.7.11
1.7.11 (core)/ 0.23.11 (libraries)
New
[ui] Improved performance for loading assets that are part of big asset graphs.
[ui] Improved performance for loading job backfills that have thousands of partitions
[ui] The code location page can now be filtered by status
[agent] K8s and ECS agent main loop writes a sentinel file that can be used for liveness checks.
[agent][experimental] ECS CloudFormation template with private IP addresses using NAT Gateways, security groups, IAM role separation, tighter permissions requirements, and improved documentation.
Ephemeral asset jobs are now supported in run status sensors (thanks @the4thamigo-uk)!
Bugfixes
In AssetsDefinition construction, enforce single key per output name
Fixed a bug where freshness checks on assets with both observations and materializations would incorrectly miss a materialization if there’s no observation with dagster/last_updated_timestamp.
Fixed a bug with anomaly detection freshness checks where “not enough records” result would cause the sensor to crash loop.
Fixed a bug that could cause errors in the Asset Daemon if an asset using AutoMaterializeRule.skip_on_not_all_parents_updated_since_cron() rule gained a new dependency with a different PartitionsDefinition.
[ui] Fixed an issue that caused the backfill page not to be scrollable.
[ui] Fixed an issue where filtering by partition on the Runs page wouldn’t work if fetching all of your partitions timed out.
[dagster-dlt] Fixed bug with dlt integration in which partitioned assets would change the file name when using the filesystem destination.
[ui] Fixed an issue where an erroring code location would cause multiple toast popups.
Allow a string to be provided for source_key_prefix arg of load_assets_from_modules. (thanks @drjlin)!
Added a missing debug level log message when loading partitions with polars (thanks Daniel Gafni)!
Set postgres timeout via statement, which improves storage-layer compatibility with Amazon RDS (thanks @james lewis)!
In DBT integration, quote the table identifiers to handle cases where table names require quotes due to special characters. (thanks @alex launi)!
remove deprecated param usage in dagster-wandb integration (thanks @chris histe)!
Add missing QUEUED state to DatabricksRunLifeCycleState (thanks @gabor ratky)!
Fixed a bug with dbt-cloud integration subsetting implementation (thanks @ivan tsarev)!
Breaking Changes
[dagster-airflow] load_assets_from_airflow_dag no longer allows multiple tasks to materialize the same asset.
Documentation
Added type-hinting to backfills example
Added syntax highlighting to some examples (thanks @Niko)!
The dagster-cloud ci init CLI will now use the --deployment argument as the base deployment when creating a branch deployment. This base deployment will be used for Change Tracking.
The BigQuery dbt insights wrapper dbt_with_bigquery_insights now respects CLI arguments for profile configuration and also selects location / dataset from the profile when available.
[experimental feature] Fixes a recent regression where the UI errored upon attempting to create an insights metric alert.
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Bumps dagster from 1.7.10 to 1.7.12.
Changelog
Sourced from dagster's changelog.
Commits
36968cc
1.7.12ef82147
[DA] Update eager condition (#22746)939cb25
Fix navigating to folders in asset catalog (#22764)7c297a4
[Asset graph] Fix graph data refetch loop in job asset graph page (#22762)51b4e96
partial revert [PipelineRootExplorer] load by snapshotId when available from ...71a860a
Automation: versioned docs for 1.7.1128aa0a8
1.7.11a6b232f
changelog 1.7.11 (#22752)2393dd8
fix(dbt): ensureexternal_assets_from_specs
composes with `build_dbt_asset_...c3a66e8
[pandera] pin < 0.20.0 (#22737)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show