Closed zhongzc closed 3 months ago
[!NOTE]
Reviews paused
Use the following commands to manage reviews:
@coderabbitai resume
to resume automatic reviews.@coderabbitai review
to trigger a single review.
The update introduces a new configuration parameter region_engine.mito.inverted_index.compress
to control the compression of inverted index data. It also refactors the handling and management of inverted index creation, including restructuring indexer logic and updating various modules. Additionally, deprecated settings are replaced, and new default values are defined. Error handling and configuration are streamlined, enhancing the robustness and maintainability of the system.
File(s) | Change Summary |
---|---|
config/config.md , .../datanode.example.toml , .../standalone.example.toml |
Added new configuration compress for inverted index data. Deprecated intermediate_path . |
src/mito2/src/access_layer.rs |
Introduced OperationType enum. Refactored SstWriteRequest to use InvertedIndexConfig . |
src/mito2/src/cache/write_cache.rs |
Added PuffinManagerFactory . Updated WriteCache methods. |
src/mito2/src/compaction/compactor.rs |
Removed old index configuration. Added inverted_index_config . Refined index determination during compaction. |
src/mito2/src/config.rs |
Added compress field to InvertedIndexConfig struct. |
src/mito2/src/engine/basic_test.rs |
Updated assertion value in test_region_usage function. |
src/mito2/src/error.rs |
Removed PuffinFinish variant from Error enum. |
src/mito2/src/flush.rs |
Refactored SstWriteRequest and RegionFlushTask logic. |
src/mito2/src/read/scan_region.rs |
Updated import paths for SstIndexApplierBuilder and SstIndexApplierRef . |
src/mito2/src/sst/index.rs , src/mito2/src/sst/index/indexer.rs |
Introduced new indexer module structure. Updated index creation logic. |
src/mito2/src/sst/index/indexer/abort.rs , src/mito2/src/sst/index/indexer/finish.rs |
Added methods for aborting and finishing index processes. |
src/mito2/src/sst/index/indexer/update.rs |
Introduced methods for updating inverted index within Indexer struct. |
.../sst/index/inverted_index.rs , .../sst/index/inverted_index/applier.rs |
Updated module structure for managing inverted index. |
.../sst/index/inverted_index/applier/builder.rs |
Updated import paths for SstIndexApplierBuilder . |
.../sst/index/inverted_index/applier/builder/{between.rs, comparison.rs, eq_list.rs, in_list.rs} |
Updated import paths for SstIndexApplierBuilder in respective modules. |
.../sst/index/inverted_index/applier/builder/regex_match.rs |
Updated import paths for SstIndexApplierBuilder and related tests. |
In the code fields, changes bloom,
Inverted indexes do resume.
Compress or not, the choice's here,
Enhancements bring much cheer!
Refactored paths and fresher air,
Errors handled with much care.
The system stands robust, a new frontier! 🌸
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?
@coderabbitai pause
Attention: Patch coverage is 78.57143%
with 78 lines
in your changes missing coverage. Please review.
Project coverage is 85.02%. Comparing base (
6e2c21d
) to head (133d354
). Report is 9 commits behind head on main.
I hereby agree to the terms of the GreptimeDB CLA.
Refer to a related PR or issue link (optional)
4246
What's changed and what's your intention?
...to make room for the addition of full-text indexer
Checklist
Summary by CodeRabbit
New Features
Deprecations
intermediate_path
setting in favor ofregion_engine.mito.index.aux_path
.Refactor
Bug Fixes
Documentation