coveralls
commented
5 years ago Pull Request Test Coverage Report for Build 470
- 25 of 29 (86.21%) changed or added relevant lines in 10 files are covered.
- 14 unchanged lines in 10 files lost coverage.
- Overall coverage decreased (-0.03%) to 79.973%
| Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | ||
|---|---|---|---|---|---|
| waimak-core/src/main/scala/com/coxautodata/waimak/filesystem/FSUtils.scala | 0 | 4 | 0.0% | ||
| <!-- | Total: | 25 | 29 | 86.21% | --> |
| Totals | |
|---|---|
| Change from base Build 461: | -0.03% |
| Covered Lines: | 1190 |
| Relevant Lines: | 1488 |
Description
Adds an option to not retain storage history for specific tables, and as such for them to be deduplicated when compaction happens. This is useful for keeping storage size down in situations where you may have a large number of duplicates in the table, for example lookup tables which are extracted into the storage layer in full every time.
For RDBM extraction, the default behaviour is to retain history for tables which have a lastUpdated column, and to not retain history for those without. The choice of this default behaviour is because, without a lastUpdatedColumn, the table will be extracted in full every time extraction is performed, causing the size of the data in storage to grow uncontrollably. To override this behaviour, you will need to set
forceRetainStorageHistoryon theRDBMExtractionTableConfigfor each table.Fixes #64
Type of change
Please delete options that are not relevant.
This is mostly non-breaking, however an additional, non-optional field has been added to
AuditTableInfo, so direct instantiations of this will break.How Has This Been Tested?
Updated existing unit tests and added new ones.