coveralls
commented
1 week ago Pull Request Test Coverage Report for Build 11973201274
Details
- 15 of 15 (100.0%) changed or added relevant lines in 2 files are covered.
- 14 unchanged lines in 10 files lost coverage.
- Overall coverage decreased (-0.4%) to 80.314%
| Totals | |
|---|---|
| Change from base Build 11124453738: | -0.4% |
| Covered Lines: | 1277 |
| Relevant Lines: | 1590 |
We use the
Migrations.mergeSchemafunction in the loaders, for combining a series of schemas (e.g.1-0-0,1-0-1,1-0-2) into a reconciled columnBefore this PR,
mergeSchemascontained some logic to preserve field order... but it was the wrong logic. It preserved field order of the newer schema, ignoring whether a field was present in the older schema.After this PR, we preserve field order of the older schema. New fields added in a later schema are appended to the end of the field list.
This feature change is needed for loaders that only allow field additions when they are appended to the end of a struct. E.g. the Lake Loader for Hudi/Glue.