search

elastic / elasticsearch

Free and Open, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.4k stars 24.56k forks source link

TSDS - New Index Not Appearing in _cat/indices API After Downsampling #110871

Open dbeast-co opened 1 month ago

dbeast-co commented 1 month ago

Elasticsearch Version

8.8.2, 8.14.3

Installed Plugins

No response

Java Version

bundled

OS Version

Windows 11

Problem Description

After performing a downsample on an index, the new downsampled index does not appear in the _cat/indices API.

Steps to Reproduce

  1. Create an Index Lifecycle Management (ILM) policy.
  2. Create an index template with the Time Series Data Stream (TSDS) definition, settings, and mappings.
  3. Ingest data into the data stream.
  4. Perform a rollover on the index.
  5. Block the old index with the command: PUT /.ds-my-index-2024.07.09-000002/_block/write
  6. Downsample the index with the command: 
    POST .ds-my-index-2024.07.09-000002/_downsample/.ds-my-index-2024.07.09-000002-ds
{
"fixed_interval": "10m"
}
  7. Wait until the downsample task is completed.
  8. Check if the new downsampled index exists using the _cat/indices API

Logs (if relevant)

No response

elasticsearchmachine commented 1 month ago

Pinging @elastic/es-storage-engine (Team:StorageEngine)