LogsDB - Data Migration Testing

Description

As part of the effort to test integration of LogsDB we would like to run data-migration testing. We would like to make sure the migration process of log data from existing storage solutions to the new “logs” index mode and vice versa works seamlessly. Users should be able to restore indices from snapshots and source-only snapshots and eventually rely on reindexing to migrate existing data.

[ ] Reindex a "logs" index from an index whose index mode is “standard”. Make sure reindexing is successful.
[ ] Create a snapshot out of an index using index mode is set to “logs”. Make sure snapshot creation is successful.
[ ] Restore a snapshot that was created out of an index whose index mode was set to “logs” at snapshot creation time. Make sure restoring the snapshot is successful.
[ ] Create a source-only snapshot from an index whose index mode is “logs”. Make sure snapshot creation is successful.
[ ] Restore a source-only snapshot that was created out of an index whose index mode was set to “logs” at snapshot creation time. Make sure restoring the source-only snapshot is successful. Notice that a source-only snapshot only has stored fields and metadata and is missing doc values and inverted index. A source-only snapshot normally requires reindexing.
[ ] Restore a source-only snapshot that was created out of an index whose index mode was set to “logs” at snapshot creation time. Make sure restoring the source-only snapshot is successful. Reindex the restored index using mappings and settings stored together with the source-only snapshot metadata making sure reindexing results in a LogsDB index with settings and mappings matching the original index ones.

elastic / elasticsearch

LogsDB - Data Migration Testing #109803

Description