Fix a bug where older data of an ingested key can be returned for read when universal compaction is used
Apply appropriate rate limiting and priorities in more places.
8.11.0 (01/19/2024)
New Features
Add new statistics: rocksdb.sst.write.micros measures time of each write to SST file; rocksdb.file.write.{flush|compaction|db.open}.micros measure time of each write to SST table (currently only block-based table format) and blob file for flush, compaction and db open.
Public API Changes
Added another enumerator kVerify to enum class FileOperationType in listener.h. Update your switch statements as needed.
Add CompressionOptions to the CompressedSecondaryCacheOptions structure to allow users to specify library specific options when creating the compressed secondary cache.
Deprecated several options: level_compaction_dynamic_file_size, ignore_max_compaction_bytes_for_input, check_flush_compaction_key_order, flush_verify_memtable_count, compaction_verify_record_count, fail_if_options_file_error, and enforce_single_del_contracts
Exposed options ttl via c api.
Behavior Changes
rocksdb.blobdb.blob.file.write.micros expands to also measure time writing the header and footer. Therefore the COUNT may be higher and values may be smaller than before. For stacked BlobDB, it no longer measures the time of explictly flushing blob file.
Files will be compacted to the next level if the data age exceeds periodic_compaction_seconds except for the last level.
Reduced the compaction debt ratio trigger for scheduling parallel compactions
For leveled compaction with default compaction pri (kMinOverlappingRatio), files marked for compaction will be prioritized over files not marked when picking a file from a level for compaction.
Bug Fixes
Fix bug in auto_readahead_size that combined with IndexType::kBinarySearchWithFirstKey + fails or iterator lands at a wrong key
Fixed some cases in which DB file corruption was detected but ignored on creating a backup with BackupEngine.
Fix bugs where rocksdb.blobdb.blob.file.synced includes blob files failed to get synced and rocksdb.blobdb.blob.file.bytes.written includes blob bytes failed to get written.
Fixed a possible memory leak or crash on a failure (such as I/O error) in automatic atomic flush of multiple column families.
Fixed some cases of in-memory data corruption using mmap reads with BackupEngine, sst_dump, or ldb.
Fixed issues with experimental preclude_last_level_data_seconds option that could interfere with expected data tiering.
Fixed the handling of the edge case when all existing blob files become unreferenced. Such files are now correctly deleted.
RocksDB 8.10.2
8.10.2 (02/16/2024)
Update zlib to 1.3.1 for Java builds
8.10.1 (01/16/2024)
Bug Fixes
Fix bug in auto_readahead_size that combined with IndexType::kBinarySearchWithFirstKey + fails or iterator lands at a wrong key
Fix a bug where older data of an ingested key can be returned for read when universal compaction is used
Apply appropriate rate limiting and priorities in more places.
8.11.0 (01/19/2024)
New Features
Add new statistics: rocksdb.sst.write.micros measures time of each write to SST file; rocksdb.file.write.{flush|compaction|db.open}.micros measure time of each write to SST table (currently only block-based table format) and blob file for flush, compaction and db open.
Public API Changes
Added another enumerator kVerify to enum class FileOperationType in listener.h. Update your switch statements as needed.
Add CompressionOptions to the CompressedSecondaryCacheOptions structure to allow users to specify library specific options when creating the compressed secondary cache.
Deprecated several options: level_compaction_dynamic_file_size, ignore_max_compaction_bytes_for_input, check_flush_compaction_key_order, flush_verify_memtable_count, compaction_verify_record_count, fail_if_options_file_error, and enforce_single_del_contracts
Exposed options ttl via c api.
Behavior Changes
rocksdb.blobdb.blob.file.write.micros expands to also measure time writing the header and footer. Therefore the COUNT may be higher and values may be smaller than before. For stacked BlobDB, it no longer measures the time of explictly flushing blob file.
Files will be compacted to the next level if the data age exceeds periodic_compaction_seconds except for the last level.
Reduced the compaction debt ratio trigger for scheduling parallel compactions
For leveled compaction with default compaction pri (kMinOverlappingRatio), files marked for compaction will be prioritized over files not marked when picking a file from a level for compaction.
Bug Fixes
Fix bug in auto_readahead_size that combined with IndexType::kBinarySearchWithFirstKey + fails or iterator lands at a wrong key
Fixed some cases in which DB file corruption was detected but ignored on creating a backup with BackupEngine.
Fix bugs where rocksdb.blobdb.blob.file.synced includes blob files failed to get synced and rocksdb.blobdb.blob.file.bytes.written includes blob bytes failed to get written.
Fixed a possible memory leak or crash on a failure (such as I/O error) in automatic atomic flush of multiple column families.
Fixed some cases of in-memory data corruption using mmap reads with BackupEngine, sst_dump, or ldb.
Fixed issues with experimental preclude_last_level_data_seconds option that could interfere with expected data tiering.
Fixed the handling of the edge case when all existing blob files become unreferenced. Such files are now correctly deleted.
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Bumps org.rocksdb:rocksdbjni from 8.10.0 to 8.11.3.
Release notes
Sourced from org.rocksdb:rocksdbjni's releases.
Changelog
Sourced from org.rocksdb:rocksdbjni's changelog.
Commits
c2467b1Update version.h and HISTORY for 8.11.3ef0caddCorrect CMake Javadoc and source jar builds (#12371)9d9014dUpdate HISTORY and version for 8.11.2412b7fdUpdate ZLib to 1.3.1 (#12358)8a201ceMark destructors as overridden (#12324)a530949Version bump and HISTORY for 8.11.1 patchcc20520Pass rate_limiter_priority from SequentialFileReader to FS (#12296)36797a4Rate-limit un-ratelimited flush/compaction code paths (#12290)7c06a1eFix bug of newer ingested data assigned with an older seqno (#12257)d9e7f6aFix UB/crash in new SeqnoToTimeMapping::CopyFromSeqnoRange (#12293)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show