-
Append-only schema evolution is a widely-requested feature. Some of the work has already been done in [protoss](https://github.com/djkoloski/protoss) but it needs to be refreshed and finished.
-
## Notion epic
**Link:** https://www.notion.so/persist-schema-evolution-fdb6696cbed04b1494d610611ca5538c
**Product brief:**
**Status:** In progress
**Prioritization:** 08 - August
**Estimated …
-
**Describe the problem you faced**
If `hoodie.schema.on.read.enable` is set to **true** in spark-sql then `describe table` command provides much less information about the table. Describe's output …
-
### Describe the feature
Add support for the new `MERGE WITH SCHEMA EVOLUTION` syntax available on the current and preview channel SQL Warehouse versions. https://docs.databricks.com/en/delta/update-…
-
### Discussed in https://github.com/delta-io/delta-rs/discussions/2281
Originally posted by **cesar-vermeulen** March 11, 2024
Hello!
With the awsome addition of merge schema support in the…
-
**Describe the problem you faced**
hello i try to test several schema evolution usecases using hudi 0.15 and spark3.5 using hms 4
first test: Adding column in PG --> debezium / schema registry ok --…
-
It was noticed in https://github.com/cms-sw/cmssw/issues/45888 that there is a class of schema evolution failures (at least the case of `TStreamerInfo` being missing https://github.com/cms-sw/cmssw/is…
-
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Motivation
Support schema evolution about nested data type such as…
-
Schemas change over time. Especially with schema inference, we often end up with multiple schemas of the same name that are actually different under the hood.
We have the schema id to filter this out…
-
Currently, the schema detection mechanism implemented in the deltaLake table function doesn't support schema changes when the data source folder contains files with the old and new schema.
Steps t…