search

elastic / elasticsearch

Free and Open, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
68.54k stars 24.34k forks source link

Synthetic source and source-only snapshots testing #109333

Open salvatore-campagna opened 1 month ago

salvatore-campagna commented 1 month ago

Description

Source-only repositories store source-only snapshots and allows users to reduce storage usage when using snapshots. Source-only snapshots store only metadata and stored fields (the _source field is stored), while doc values and inverted indices are not stored. Source-only snapshots are only supported if the _source field is enabled and no source-filtering is used.

For index modes using synthetic source by default, like tsdb and logsdb, we need to make sure we have a path allowing users to still use source-only snapshots by reindexing or directly supporting at least a limited set of queries (match_all and get). Such snapshots normally need reindexing to be searchable.

elasticsearchmachine commented 1 month ago

Pinging @elastic/es-storage-engine (Team:StorageEngine)