search

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.71k stars 24.67k forks source link

ESQL: Allow limiting search to certain data tiers #108264

Open nik9000 opened 5 months ago

nik9000 commented 5 months ago

Description

Kibana's discover has a setting that lets you limit searching to certain tiers (hot, warm, cold, frozen, whatever). That's something ESQL should at least be able to work with. And we should be able to provide the same speed savings for it - namely, we should make sure that such limits prevent us from hitting shards on that tier at all.

We should probably also be able to reference the tier as a bit of index metadata so you can view it in the language. And, likely filter on it there as well.

elasticsearchmachine commented 5 months ago

Pinging @elastic/es-analytical-engine (Team:Analytics)

bpintea commented 4 months ago

I've opened #108558, exposing the _tier metadata field might then make it easy to apply the restriction. Currently this should be doable by using this field in the filter param.

bpintea commented 2 weeks ago

Related: https://github.com/elastic/elasticsearch/issues/113093