search

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
1.15k stars 24.84k forks source link

TSDS - New Index Not Appearing in _cat/indices API After Downsampling #110871

Open dbeast-co opened 4 months ago

dbeast-co commented 4 months ago

Elasticsearch Version

8.8.2, 8.14.3

Installed Plugins

No response

Java Version

bundled

OS Version

Windows 11

Problem Description

After performing a downsample on an index, the new downsampled index does not appear in the _cat/indices API.

Steps to Reproduce

  1. Create an Index Lifecycle Management (ILM) policy.
  2. Create an index template with the Time Series Data Stream (TSDS) definition, settings, and mappings.
  3. Ingest data into the data stream.
  4. Perform a rollover on the index.
  5. Block the old index with the command: PUT /.ds-my-index-2024.07.09-000002/_block/write
  6. Downsample the index with the command: 
    POST .ds-my-index-2024.07.09-000002/_downsample/.ds-my-index-2024.07.09-000002-ds
{
"fixed_interval": "10m"
}
  7. Wait until the downsample task is completed.
  8. Check if the new downsampled index exists using the _cat/indices API

Logs (if relevant)

No response

elasticsearchmachine commented 3 months ago

Pinging @elastic/es-storage-engine (Team:StorageEngine)