datafuselabs / databend

๐——๐—ฎ๐˜๐—ฎ, ๐—”๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ & ๐—”๐—œ. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.29k stars 701 forks source link

refactor: sync create inverted index #15379

Closed b41sh closed 2 weeks ago

b41sh commented 2 weeks ago

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

Due to the long time to create the inverted index, in the case of continuous insertion of data, there may be a problem that there is data block but the index does not exist, resulting in query failure. To solve this problem, inverted index refresh is changed to synchronised with data block creation, similar to bloom index.

Other changes

part of #14825

Tests

Type of change


This change isโ€‚Reviewable