LogsDB - Quality Assurance Testing

[salvatore-campagna]

Description

As part of the effort to test integration of LogsDB we would like to run quality assurance testing. LogsDB should work seamlessly when used in place of standard indices. Ideally LogsDB should transparently replace standard indices except for non-functional characteristics when it comes to indexing throughput, query latency and storage footprint.

• [ ] Create a new Elasticsearch datastream using standard index and another datastream using LogsDB. Index the same set of documents in both datastreams. Make sure no indexing error takes place while indexing in both datastreams.
• [ ] Create a new Elasticsearch datastream using standard index and another datastream using LogsDB. Index the same set of documents in both clusters’ datastreams. Run the same query in both clusters and check results are the same, taking into account that the cluster using LogsDB uses synthetic source. Make sure to generate queries both using ESQL and Elasticsearch query DSL.
• [ ] Create a new Elasticsearch datastream using standard index and another datastream using LogsDB. Retrieve all field capabilities using both datastreams as targets. Compare field caps api responses making sure the result is the same.

[elasticsearchmachine]

Pinging @elastic/es-storage-engine (Team:StorageEngine)