LogsDB - Performance Testing

[salvatore-campagna]

Description

As part of the effort to test integration of LogsDB we would like to run performance testing taking advantage of Rally. Our focus is on comparing indexing throughput, query latency and storage footprint when indexing, querying and storing logs in LogsDB ve standard indices.

• [ ] Create and run a new LogsDB track from the elastic/logging and http_logs Rally tracks and compare indexing throughput performance versus standard indexing mode.
• [ ] Create and run a new LogsDB track from the elastic/logging and http_logs Rally tracks and compare query latency performance versus standard indexing mode.
• [ ] Create and run a new LogsDB track from the elastic/logging and http_logs Rally tracks and compare storage footprint performance versus standard indexing mode.
• [ ] Create and run a new LogsDB challenge from the elastic/logging and http_logs tracks which executes ESQL queries. Compare query latency performance versus standard indexing mode (notice that the http_logs track does not have a specific ESQL challenge while elastic/logging already has one).

[elasticsearchmachine]

Pinging @elastic/es-storage-engine (Team:StorageEngine)