search

manticoresoftware / manticoresearch

Easy to use open source fast database for search | Good alternative to Elasticsearch now | Drop-in replacement for E in the ELK soon
https://manticoresearch.com
GNU General Public License v3.0
9.08k stars 510 forks source link

fix test-migration-es-ms.rec #2722

Closed PavelShilin89 closed 2 weeks ago

PavelShilin89 commented 3 weeks ago

Description of Changes in GitHub Actions

Added configuration for automatic triggering of GitHub Actions in the following cases:

  1. When changes are made to the Elasticsearch/Manticore migration test files: • Path: test/clt-tests/migration-es-ms/**
  2. When changes are made to the mysqldump test files for various versions: • Path: test/clt-tests/mysqldump/versions/**
  3. When changes are made to the workflow configuration: • Path: .github/workflows/nightly_dumps.yml

CLT-test test-migration-es-ms.rec has been updated.

github-actions[bot] commented 3 weeks ago

clt_test_migration_es_ms

👎 CLT tests in test/clt-tests/migration-es-ms/ ✅ OK: 0 ❌ Failed: 1 ⏳ Duration: 50s 👉 Check Action Results for commit 0f766dd Failed tests:

test/clt-tests/migration-es-ms/test-migration-es-ms.rec ```diff ––– input ––– (dockerd > /var/log/dockerd.log 2>&1 &) > /dev/null ––– output ––– ––– input ––– if timeout 30 grep -qm1 'API listen on /var/run/docker.sock' <(tail -n 0 -f /var/log/dockerd.log); then echo 'Done'; else echo 'Timeout failed'; fi ––– output ––– Done ––– input ––– docker ps ––– output ––– CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES ––– input ––– docker pull -q ghcr.io/manticoresoftware/manticoresearch:test-kit-latest > /dev/null 2>&1; echo $? ––– output ––– 0 ––– input ––– docker pull docker.elastic.co/elasticsearch/elasticsearch:7.5.2 > /dev/null ––– output ––– ––– input ––– apk add npm > /dev/null 2>&1; echo $? ––– output ––– 0 ––– input ––– npm install elasticdump -g elasticdump > /dev/null 2>&1; echo $? ––– output ––– 0 ––– input ––– docker network create test_network > /dev/null ––– output ––– ––– input ––– docker run -it --privileged --network=test_network --entrypoint=docker-entrypoint.sh --platform linux/amd64 --name manticore -p 9306:9306 -p 9308:9308 -d ghcr.io/manticoresoftware/manticoresearch:test-kit-latest searchd -c /etc/manticoresearch/manticore.conf.sh --nodetach > /dev/null; echo $? ––– output ––– 0 ––– input ––– docker run -d --name elasticsearch --platform linux/amd64 --net test_network -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" elasticsearch:7.5.2 > /dev/null 2>&1; echo $? ––– output ––– 0 ––– input ––– unzip ./test/clt-tests/migration-es-ms/index.zip -d ./test/clt-tests/migration-es-ms/ ––– output ––– Archive: ./test/clt-tests/migration-es-ms/index.zip inflating: index_mapping.json inflating: index_data.json ––– input ––– elasticdump --input=./test/clt-tests/migration-es-ms/index_mapping.json --output=http://localhost:9200/es-index --type=mapping ––– output ––– #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | starting dump #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 1 objects from source file (offset: 0) #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | sent 1 objects to destination elasticsearch, wrote 2 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | dump complete + Sun, 03 Nov 2024 20:03:08 GMT | got 0 objects from source file (offset: 1) + Sun, 03 Nov 2024 20:03:08 GMT | Total Writes: 2 + Sun, 03 Nov 2024 20:03:08 GMT | dump complete ––– input ––– elasticdump --input=http://localhost:9200/es-index --output=http://localhost:9308/ms_index --type=data ––– output ––– #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | starting dump - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 100 objects from source elasticsearch (offset: 0) + Sun, 03 Nov 2024 20:03:09 GMT | got 0 objects from source elasticsearch (offset: 0) - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | sent 100 objects to destination elasticsearch, wrote 100 + Sun, 03 Nov 2024 20:03:09 GMT | Total Writes: 0 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 100 objects from source elasticsearch (offset: 100) + Sun, 03 Nov 2024 20:03:09 GMT | dump complete - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | sent 100 objects to destination elasticsearch, wrote 100 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 100 objects from source elasticsearch (offset: 200) - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | sent 100 objects to destination elasticsearch, wrote 100 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 100 objects from source elasticsearch (offset: 300) - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | sent 100 objects to destination elasticsearch, wrote 100 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 64 objects from source elasticsearch (offset: 400) - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | sent 64 objects to destination elasticsearch, wrote 64 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | got 0 objects from source elasticsearch (offset: 464) - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | Total Writes: 464 - #!/[A-Za-z]{3},\s+\d{2}\s+[A-Za-z]{3}\s+\d{4}\s+\d{2}:\d{2}:\d{2}\s+GMT/!# | dump complete ––– input ––– docker exec manticore mysql -h0 -P9306 -e "SELECT COUNT(*) FROM ms_index;" ––– output ––– - +----------+ + ERROR 1064 (42000) at line 1: unknown local table(s) 'ms_index' in search request - | count(*) | - +----------+ - | 464 | - +----------+ ––– input ––– docker exec manticore mysql -h0 -P9306 -e "DESCRIBE ms_index;" ––– output ––– - +-----------------+-----------+----------------+ + ERROR 1064 (42000) at line 1: no such table 'ms_index' - | Field | Type | Properties | - +-----------------+-----------+----------------+ - | id | bigint | | - | message | text | indexed stored | - | @timestamp | timestamp | | - | extra_timestamp | timestamp | | - | field | string | | - | field10 | string | | - | field11 | string | | - | field12 | string | | - | field13 | string | | - | field14 | string | | - | field15 | string | | - | field16 | string | | - | field17 | string | | - | field18 | string | | - | field2 | string | | - | field3 | string | | - | field4 | string | | - | field5 | string | | - | field6 | string | | - | field7 | string | | - | field8 | string | | - | field9 | string | | - | log | json | | - +-----------------+-----------+----------------+ ––– input ––– docker exec manticore mysql -h0 -P9306 -e "SELECT * FROM ms_index;" ––– output ––– - +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+-----------------+-------+------------------------+-----------------------+--------------------------------------------------------------+--------------+------------------------------------------------------------------+------------------------------+--------------------------+-------------------------+--------------------------+-------------+-----------+----------------------------------------------------------------------+---------------+---------+----------------+----------+-----------------+------------------+ + ERROR 1064 (42000) at line 1: unknown local table(s) 'ms_index' in search request - | id | message | @timestamp | extra_timestamp | field | field10 | field11 | field12 | field13 | field14 | field15 | field16 | field17 | field18 | field2 | field3 | field4 | field5 | field6 | field7 | field8 | field9 | log | - +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+-----------------+-------+------------------------+-----------------------+--------------------------------------------------------------+--------------+------------------------------------------------------------------+------------------------------+--------------------------+-------------------------+--------------------------+-------------+-----------+----------------------------------------------------------------------+---------------+---------+----------------+----------+-----------------+------------------+ - | 5448198095297826404 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.099Z", "log.level": "INFO", "message":"adding index lifecycle policy [.fleet-file-tohost-data-ilm-policy]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [.fleet-file-tohost-data-ilm-policy]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 9097666193355230552 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.087Z", "log.level": "INFO", "message":"adding index lifecycle policy [.deprecation-indexing-ilm-policy]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [.deprecation-indexing-ilm-policy]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 7381722540488568573 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.074Z", "log.level": "INFO", "message":"adding index lifecycle policy [ilm-history-ilm-policy]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [ilm-history-ilm-policy]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 6911901198776545583 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.059Z", "log.level": "INFO", "message":"adding index lifecycle policy [watch-history-ilm-policy-16]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [watch-history-ilm-policy-16]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 4157627641165230591 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.036Z", "log.level": "INFO", "message":"adding index lifecycle policy [slm-history-ilm-policy]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [slm-history-ilm-policy]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 948096711986651649 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.019Z", "log.level": "INFO", "message":"adding index lifecycle policy [180-days-default]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [180-days-default]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 4718977505436221020 | 2024-04-08 23:48:07 {"@timestamp":"2024-04-08T21:48:07.006Z", "log.level": "INFO", "message":"adding index lifecycle policy [180-days@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620087 | 1712612887 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [180-days@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 5628374973127727282 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.991Z", "log.level": "INFO", "message":"adding index lifecycle policy [90-days@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [90-days@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 6918063120946876514 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.978Z", "log.level": "INFO", "message":"adding index lifecycle policy [90-days-default]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [90-days-default]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 2003240025326794422 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.963Z", "log.level": "INFO", "message":"adding index lifecycle policy [365-days-default]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [365-days-default]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 1035703439441705855 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.945Z", "log.level": "INFO", "message":"adding index lifecycle policy [365-days@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [365-days@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 9200630174028921389 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.929Z", "log.level": "INFO", "message":"adding index lifecycle policy [synthetics@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [synthetics@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 4259798338765043837 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.913Z", "log.level": "INFO", "message":"adding index lifecycle policy [7-days@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [7-days@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 3777995070567678103 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.891Z", "log.level": "INFO", "message":"adding index lifecycle policy [logs@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [logs@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 7236771320172416990 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.861Z", "log.level": "INFO", "message":"adding index lifecycle policy [30-days@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [30-days@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 5128701379809434320 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.839Z", "log.level": "INFO", "message":"adding index lifecycle policy [metrics@lifecycle]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [metrics@lifecycle]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 8792590799816885056 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.806Z", "log.level": "INFO", "message":"adding index lifecycle policy [logs]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [logs]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 8828760827591472844 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.787Z", "log.level": "INFO", "message":"adding index lifecycle policy [metrics]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [metrics]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 7103584392189579473 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.768Z", "log.level": "INFO", "message":"adding index lifecycle policy [synthetics]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [synthetics]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - | 3538954593482063643 | 2024-04-08 23:48:06 {"@timestamp":"2024-04-08T21:48:06.753Z", "log.level": "INFO", "message":"adding index lifecycle policy [7-days-default]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[7b293a37e356][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction","elasticsearch.cluster.uuid":"jPcjqWmSTB6G7rhqAxWiMQ","elasticsearch.node.id":"30m7h3bDTHCG2-Z3R-07tg","elasticsearch.node.name":"7b293a37e356","elasticsearch.cluster.name":"docker-cluster"} | 1712620086 | 1712612886 | ":" | "elasticsearch.server" | "process.thread.name" | "elasticsearch[7b293a37e356][masterService#updateTask][T#1]" | "log.logger" | "org.elasticsearch.xpack.ilm.action.TransportPutLifecycleAction" | "elasticsearch.cluster.uuid" | "jPcjqWmSTB6G7rhqAxWiMQ" | "elasticsearch.node.id" | "30m7h3bDTHCG2-Z3R-07tg" | "log.level" | "message" | "adding index lifecycle policy [7-days-default]" | "ecs.version" | "1.2.0" | "service.name" | "ES_ECS" | "event.dataset" | {"level":"INFO"} | - +---------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------+-----------------+-------+------------------------+-----------------------+--------------------------------------------------------------+--------------+------------------------------------------------------------------+------------------------------+--------------------------+-------------------------+--------------------------+-------------+-----------+----------------------------------------------------------------------+---------------+---------+----------------+----------+-----------------+------------------+ ––– input ––– rm ./test/clt-tests/migration-es-ms/index_mapping.json ./test/clt-tests/migration-es-ms/index_data.json ––– output ––– ```