jasonwee / videoOnCloud

just 4 fun project.
Apache License 2.0
2 stars 2 forks source link

research about opensearch #3

Open jasonwee opened 2 years ago

jasonwee commented 2 years ago

work done commit to this repository https://github.com/jasonwee/MyMachineLearningArtificialIntelligence

OTHER-2484

jasonwee commented 2 years ago
$ ./opensearch-tar-install.sh 
**************************************************************************
** This tool will be deprecated in the next major release of OpenSearch **
** https://github.com/opensearch-project/security/issues/1755           **
**************************************************************************
OpenSearch Security Demo Installer
 ** Warning: Do not use on production or public reachable systems **
Basedir: /home/user/opensearch/opensearch-2.2.0
OpenSearch install type: .tar.gz on PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
OpenSearch config dir: /home/user/opensearch/opensearch-2.2.0/config
OpenSearch config file: /home/user/opensearch/opensearch-2.2.0/config/opensearch.yml
OpenSearch bin dir: /home/user/opensearch/opensearch-2.2.0/bin
OpenSearch plugins dir: /home/user/opensearch/opensearch-2.2.0/plugins
OpenSearch lib dir: /home/user/opensearch/opensearch-2.2.0/lib
Detected OpenSearch Version: x-content-2.2.0
Detected OpenSearch Security Version: 2.2.0.0

### Success
### Execute this script now on all your nodes and then start all nodes
### OpenSearch Security will be automatically initialized.
### If you like to change the runtime configuration 
### change the files in ../../../config/opensearch-security and execute: 
"/home/user/opensearch/opensearch-2.2.0/plugins/opensearch-security/tools/securityadmin.sh" -cd "/home/user/opensearch/opensearch-2.2.0/config/opensearch-security" -icl -key "/home/user/opensearch/opensearch-2.2.0/config/kirk-key.pem" -cert "/home/user/opensearch/opensearch-2.2.0/config/kirk.pem" -cacert "/home/user/opensearch/opensearch-2.2.0/config/root-ca.pem" -nhnv
### or run ./securityadmin_demo.sh
### To use the Security Plugin ConfigurationGUI
### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
### (Ignore the SSL certificate warning because we installed self-signed demo certificates)
done security
done plugins
k-NN libraries not found in LD_LIBRARY_PATH. Updating path to: /usr/lib/jvm/JMF-2.1.1e/lib:/home/user/opensearch/opensearch-2.2.0/plugins/opensearch-knn/lib.
Starting OpenSearch
[2022-08-20T20:58:24,036][INFO ][o.o.n.Node               ] [MyWorkstation] version[2.2.0], pid[82495], build[tar/b1017fa3b9a1c781d4f34ecee411e0cdf930a515/2022-08-09T02:27:25.256769336Z], OS[Linux/5.10.0-8-amd64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/11.0.7/11.0.7+8-LTS]
[2022-08-20T20:58:24,040][INFO ][o.o.n.Node               ] [MyWorkstation] JVM home [/usr/lib/jvm/jdk-11.0.7], using bundled JDK [false]
[2022-08-20T20:58:24,040][INFO ][o.o.n.Node               ] [MyWorkstation] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-5088462781237229132, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=/home/user/opensearch/opensearch-2.2.0/config/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/home/user/opensearch/opensearch-2.2.0, -Dopensearch.path.conf=/home/user/opensearch/opensearch-2.2.0/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
[2022-08-20T20:58:24,928][WARN ][stderr                   ] [MyWorkstation] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[2022-08-20T20:58:24,928][WARN ][stderr                   ] [MyWorkstation] SLF4J: Defaulting to no-operation (NOP) logger implementation
[2022-08-20T20:58:24,928][WARN ][stderr                   ] [MyWorkstation] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[2022-08-20T20:58:24,941][INFO ][o.o.s.s.t.SSLConfig      ] [MyWorkstation] SSL dual mode is disabled
[2022-08-20T20:58:24,942][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] OpenSearch Config path is /home/user/opensearch/opensearch-2.2.0/config
[2022-08-20T20:58:25,173][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] JVM supports TLSv1.3
[2022-08-20T20:58:25,174][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] Config directory is /home/user/opensearch/opensearch-2.2.0/config/, from there the key- and truststore files are resolved relatively
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] TLS Transport Client Provider : JDK
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] TLS Transport Server Provider : JDK
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] TLS HTTP Provider             : JDK
[2022-08-20T20:58:25,681][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2, TLSv1.1]
[2022-08-20T20:58:25,682][INFO ][o.o.s.s.DefaultSecurityKeyStore] [MyWorkstation] Enabled TLS protocols for HTTP layer      : [TLSv1.3, TLSv1.2, TLSv1.1]
[2022-08-20T20:58:25,936][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Clustername: opensearch
[2022-08-20T20:58:25,944][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Directory /home/user/opensearch/opensearch-2.2.0/config has insecure file permissions (should be 0700)
[2022-08-20T20:58:25,945][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/root-ca.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,945][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/esnode.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,945][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/esnode-key.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,946][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/kirk-key.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:25,946][WARN ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] File /home/user/opensearch/opensearch-2.2.0/config/kirk.pem has insecure file permissions (should be 0600)
[2022-08-20T20:58:26,447][INFO ][o.o.p.c.PluginSettings   ] [MyWorkstation] Trying to create directory /dev/shm/performanceanalyzer/.
[2022-08-20T20:58:26,447][INFO ][o.o.p.c.PluginSettings   ] [MyWorkstation] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true, batch-metrics-retention-period-minutes: 7, rpc-port: 9650, webservice-port 9600
[2022-08-20T20:58:26,825][INFO ][o.o.i.r.ReindexPlugin    ] [MyWorkstation] ReindexPlugin reloadSPI called
[2022-08-20T20:58:26,827][INFO ][o.o.i.r.ReindexPlugin    ] [MyWorkstation] Unable to find any implementation for RemoteReindexExtension
[2022-08-20T20:58:26,862][INFO ][o.o.j.JobSchedulerPlugin ] [MyWorkstation] Loaded scheduler extension: opendistro_anomaly_detector, index: .opendistro-anomaly-detector-jobs
[2022-08-20T20:58:26,894][INFO ][o.o.j.JobSchedulerPlugin ] [MyWorkstation] Loaded scheduler extension: reports-scheduler, index: .opendistro-reports-definitions
[2022-08-20T20:58:26,895][INFO ][o.o.j.JobSchedulerPlugin ] [MyWorkstation] Loaded scheduler extension: opendistro-index-management, index: .opendistro-ism-config
[2022-08-20T20:58:26,901][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [aggs-matrix-stats]
[2022-08-20T20:58:26,902][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [analysis-common]
[2022-08-20T20:58:26,902][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [geo]
[2022-08-20T20:58:26,902][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [ingest-common]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [ingest-geoip]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [ingest-user-agent]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [lang-expression]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [lang-mustache]
[2022-08-20T20:58:26,903][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [lang-painless]
[2022-08-20T20:58:26,904][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [mapper-extras]
[2022-08-20T20:58:26,904][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [opensearch-dashboards]
[2022-08-20T20:58:26,904][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [parent-join]
[2022-08-20T20:58:26,905][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [percolator]
[2022-08-20T20:58:26,905][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [rank-eval]
[2022-08-20T20:58:26,906][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [reindex]
[2022-08-20T20:58:26,906][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [repository-url]
[2022-08-20T20:58:26,906][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [systemd]
[2022-08-20T20:58:26,907][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded module [transport-netty4]
[2022-08-20T20:58:26,907][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-alerting]
[2022-08-20T20:58:26,908][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-anomaly-detection]
[2022-08-20T20:58:26,908][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-asynchronous-search]
[2022-08-20T20:58:26,908][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-cross-cluster-replication]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-geospatial]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-index-management]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-job-scheduler]
[2022-08-20T20:58:26,909][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-knn]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-ml]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-notifications]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-notifications-core]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-observability]
[2022-08-20T20:58:26,910][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-performance-analyzer]
[2022-08-20T20:58:26,911][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-reports-scheduler]
[2022-08-20T20:58:26,911][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-security]
[2022-08-20T20:58:26,911][INFO ][o.o.p.PluginsService     ] [MyWorkstation] loaded plugin [opensearch-sql]
[2022-08-20T20:58:26,930][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in opensearch.yml
[2022-08-20T20:58:26,957][INFO ][o.o.e.NodeEnvironment    ] [MyWorkstation] using [1] data paths, mounts [[/ (/dev/nvme0n1p2)]], net usable_space [241.1gb], net total_space [914.3gb], types [ext4]
[2022-08-20T20:58:26,957][INFO ][o.o.e.NodeEnvironment    ] [MyWorkstation] heap size [1gb], compressed ordinary object pointers [true]
[2022-08-20T20:58:26,995][INFO ][o.o.n.Node               ] [MyWorkstation] node name [MyWorkstation], node ID [n8Y5msLNReeC72ZBzFKeJQ], cluster name [opensearch], roles [ingest, remote_cluster_client, data, cluster_manager]
[2022-08-20T20:58:30,115][WARN ][o.o.s.c.Salt             ] [MyWorkstation] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2022-08-20T20:58:30,172][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Message routing enabled: true
[2022-08-20T20:58:30,221][INFO ][o.o.s.f.SecurityFilter   ] [MyWorkstation] <NONE> indices are made immutable.
[2022-08-20T20:58:30,576][INFO ][o.o.a.b.ADCircuitBreakerService] [MyWorkstation] Registered memory breaker.
[2022-08-20T20:58:30,934][INFO ][o.o.m.c.b.MLCircuitBreakerService] [MyWorkstation] Registered ML memory breaker.
[2022-08-20T20:58:31,552][INFO ][o.o.t.NettyAllocator     ] [MyWorkstation] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=1gb}]
[2022-08-20T20:58:31,651][INFO ][o.o.d.DiscoveryModule    ] [MyWorkstation] using discovery type [zen] and seed hosts providers [settings]
[2022-08-20T20:58:32,199][WARN ][o.o.g.DanglingIndicesState] [MyWorkstation] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2022-08-20T20:58:32,758][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [MyWorkstation] PerformanceAnalyzer Enabled: false
[2022-08-20T20:58:32,803][INFO ][o.o.n.Node               ] [MyWorkstation] initialized
[2022-08-20T20:58:32,803][INFO ][o.o.n.Node               ] [MyWorkstation] starting ...
[2022-08-20T20:58:32,980][INFO ][o.o.t.TransportService   ] [MyWorkstation] publish_address {127.0.0.1:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}
[2022-08-20T20:58:33,160][WARN ][o.o.b.BootstrapChecks    ] [MyWorkstation] max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2022-08-20T20:58:33,161][WARN ][o.o.b.BootstrapChecks    ] [MyWorkstation] The current JVM version 11.0.7+8-LTS is not recommended for use: for more details, please check https://github.com/opensearch-project/OpenSearch/issues/2791 and https://bugs.openjdk.java.net/browse/JDK-8259541
[2022-08-20T20:58:33,161][WARN ][o.o.b.BootstrapChecks    ] [MyWorkstation] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_cluster_manager_nodes / cluster.initial_master_nodes] must be configured
[2022-08-20T20:58:33,174][INFO ][o.o.c.c.ClusterBootstrapService] [MyWorkstation] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing cluster-manager is discovered
[2022-08-20T20:58:36,189][INFO ][o.o.c.c.Coordinator      ] [MyWorkstation] setting initial configuration to VotingConfiguration{n8Y5msLNReeC72ZBzFKeJQ}
[2022-08-20T20:58:36,423][INFO ][o.o.c.s.MasterService    ] [MyWorkstation] elected-as-cluster-manager ([1] nodes joined)[{MyWorkstation}{n8Y5msLNReeC72ZBzFKeJQ}{whOQ7KnHTW2EkBCbDrP-hA}{127.0.0.1}{127.0.0.1:9300}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_CLUSTER_MANAGER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: cluster-manager node changed {previous [], current [{MyWorkstation}{n8Y5msLNReeC72ZBzFKeJQ}{whOQ7KnHTW2EkBCbDrP-hA}{127.0.0.1}{127.0.0.1:9300}{dimr}{shard_indexing_pressure_enabled=true}]}
[2022-08-20T20:58:36,453][INFO ][o.o.c.c.CoordinationState] [MyWorkstation] cluster UUID set to [j6miohHcRFuw82YGD_QukA]
[2022-08-20T20:58:36,476][INFO ][o.o.c.s.ClusterApplierService] [MyWorkstation] cluster-manager node changed {previous [], current [{MyWorkstation}{n8Y5msLNReeC72ZBzFKeJQ}{whOQ7KnHTW2EkBCbDrP-hA}{127.0.0.1}{127.0.0.1:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
[2022-08-20T20:58:36,497][INFO ][o.o.a.c.ADClusterEventListener] [MyWorkstation] Cluster is not recovered yet.
[2022-08-20T20:58:36,518][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:36,566][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Cache cluster manager node onClusterManager time: 1661000316565
[2022-08-20T20:58:36,573][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [MyWorkstation] Config override setting update called with empty string. Ignoring.
[2022-08-20T20:58:36,596][INFO ][o.o.h.AbstractHttpServerTransport] [MyWorkstation] publish_address {127.0.0.1:9200}, bound_addresses {[::1]:9200}, {127.0.0.1:9200}
[2022-08-20T20:58:36,597][INFO ][o.o.n.Node               ] [MyWorkstation] started
[2022-08-20T20:58:36,598][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] Node started
[2022-08-20T20:58:36,598][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Will attempt to create index .opendistro_security and default configs if they are absent
[2022-08-20T20:58:36,599][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Background init thread started. Install default config?: true
[2022-08-20T20:58:36,599][INFO ][o.o.s.OpenSearchSecurityPlugin] [MyWorkstation] 0 OpenSearch Security modules loaded so far: []
[2022-08-20T20:58:36,610][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Node added: [n8Y5msLNReeC72ZBzFKeJQ]
[2022-08-20T20:58:36,613][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:36,614][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Add data node to AD version hash ring: n8Y5msLNReeC72ZBzFKeJQ
[2022-08-20T20:58:36,618][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] All nodes with known AD version: {n8Y5msLNReeC72ZBzFKeJQ=ADNodeInfo{version=2.2.0, isEligibleDataNode=true}}
[2022-08-20T20:58:36,619][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Rebuild AD hash ring for realtime AD with cooldown, nodeChangeEvents size 0
[2022-08-20T20:58:36,619][INFO ][o.o.a.c.HashRing         ] [MyWorkstation] Build AD version hash ring successfully
[2022-08-20T20:58:36,621][INFO ][o.o.a.c.ADDataMigrator   ] [MyWorkstation] Start migrating AD data
[2022-08-20T20:58:36,622][INFO ][o.o.a.c.ADDataMigrator   ] [MyWorkstation] AD job index doesn't exist, no need to migrate
[2022-08-20T20:58:36,622][INFO ][o.o.a.c.ADClusterEventListener] [MyWorkstation] Init AD version hash ring successfully
[2022-08-20T20:58:36,647][INFO ][o.o.g.GatewayService     ] [MyWorkstation] recovered [0] indices into cluster_state
[2022-08-20T20:58:36,809][INFO ][o.o.c.m.MetadataCreateIndexService] [MyWorkstation] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1]
[2022-08-20T20:58:36,820][INFO ][o.o.c.r.a.AllocationService] [MyWorkstation] updating number_of_replicas to [0] for indices [.opendistro_security]
[2022-08-20T20:58:36,954][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,095][INFO ][o.o.c.r.a.AllocationService] [MyWorkstation] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]]]).
[2022-08-20T20:58:37,131][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,133][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Index .opendistro_security created?: true
[2022-08-20T20:58:37,133][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Node started, try to initialize it. Wait for at least yellow cluster state....
[2022-08-20T20:58:37,150][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'config' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/config.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,289][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] create_mapping
[2022-08-20T20:58:37,309][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,415][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'config' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,416][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'roles' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/roles.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,445][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,469][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,502][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'roles' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,503][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'rolesmapping' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/roles_mapping.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,519][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,541][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,557][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'rolesmapping' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,558][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'internalusers' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/internal_users.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,589][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,608][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,624][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'internalusers' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,625][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'actiongroups' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/action_groups.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,649][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,675][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,694][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'actiongroups' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,694][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'tenants' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/tenants.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,714][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,740][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,759][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'tenants' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,760][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'nodesdn' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/nodes_dn.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2022-08-20T20:58:37,780][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,798][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,812][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'nodesdn' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,813][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'whitelist' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/whitelist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2022-08-20T20:58:37,830][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,849][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,862][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'whitelist' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,862][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'allowlist' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/allowlist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2022-08-20T20:58:37,880][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,905][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,917][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'allowlist' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:37,917][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Will update 'audit' with /home/user/opensearch/opensearch-2.2.0/config/opensearch-security/audit.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2022-08-20T20:58:37,948][INFO ][o.o.c.m.MetadataMappingService] [MyWorkstation] [.opendistro_security/i8i86-jXRd2zn9zgqgKaZQ] update_mapping [_doc]
[2022-08-20T20:58:37,972][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:58:37,985][INFO ][o.o.s.s.ConfigHelper     ] [MyWorkstation] Doc with id 'audit' and version 2 is updated in .opendistro_security index.
[2022-08-20T20:58:38,134][INFO ][stdout                   ] [MyWorkstation] [FINE] No subscribers registered for event class org.opensearch.security.securityconf.DynamicConfigFactory$NodesDnModelImpl
[2022-08-20T20:58:38,135][INFO ][stdout                   ] [MyWorkstation] [FINE] No subscribers registered for event class org.greenrobot.eventbus.NoSubscriberEvent
[2022-08-20T20:58:38,136][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing on REST API is enabled.
[2022-08-20T20:58:38,136][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from REST API auditing.
[2022-08-20T20:58:38,137][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing on Transport API is enabled.
[2022-08-20T20:58:38,137][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from Transport API auditing.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing of request body is enabled.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Bulk requests resolution is disabled during request auditing.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Index resolution is enabled during request auditing.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Sensitive headers auditing is enabled.
[2022-08-20T20:58:38,138][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing requests from kibanaserver users is disabled.
[2022-08-20T20:58:38,143][WARN ][o.o.s.a.r.AuditMessageRouter] [MyWorkstation] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
[2022-08-20T20:58:38,144][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing of external configuration is disabled.
[2022-08-20T20:58:38,144][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing of internal configuration is enabled.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing only metadata information for read request is enabled.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing will watch {} for read requests.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing read operation requests from kibanaserver users is disabled.
[2022-08-20T20:58:38,145][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing only metadata information for write request is enabled.
[2022-08-20T20:58:38,146][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing diffs for write requests is disabled.
[2022-08-20T20:58:38,146][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing write operation requests from kibanaserver users is disabled.
[2022-08-20T20:58:38,146][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Auditing will watch <NONE> for write requests.
[2022-08-20T20:58:38,147][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] .opendistro_security is used as internal security index.
[2022-08-20T20:58:38,147][INFO ][o.o.s.a.i.AuditLogImpl   ] [MyWorkstation] Internal index used for posting audit logs is null
[2022-08-20T20:58:38,147][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Hot-reloading of audit configuration is enabled
[2022-08-20T20:58:38,148][INFO ][o.o.s.c.ConfigurationRepository] [MyWorkstation] Node 'MyWorkstation' initialized
[2022-08-20T20:59:36,569][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Performing move cluster state metadata.
[2022-08-20T20:59:36,572][INFO ][o.o.i.i.MetadataService  ] [MyWorkstation] ISM config index not exist, so we cancel the metadata migration job.
[2022-08-20T20:59:36,573][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Performing ISM template migration.
[2022-08-20T20:59:36,576][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Doing ISM template migration 1 time.
[2022-08-20T20:59:36,578][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Use 2022-08-20T11:58:36.565Z as migrating ISM template last_updated_time
[2022-08-20T20:59:36,579][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] ISM templates: {}
[2022-08-20T20:59:36,581][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Policies to update: []
[2022-08-20T20:59:36,589][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Failure experienced when migrating ISM Template and update ISM policies: {}
[2022-08-20T20:59:36,643][INFO ][o.o.c.s.ClusterSettings  ] [MyWorkstation] updating [plugins.index_state_management.template_migration.control] from [0] to [-1]
[2022-08-20T20:59:36,644][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [MyWorkstation] Detected cluster change event for destination migration
[2022-08-20T20:59:36,647][INFO ][o.o.i.m.ISMTemplateService] [MyWorkstation] Successfully update template migration setting
[2022-08-20T21:00:36,569][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Cancel background move metadata process.
[2022-08-20T21:00:36,571][INFO ][o.o.i.i.ManagedIndexCoordinator] [MyWorkstation] Performing move cluster state metadata.
[2022-08-20T21:00:36,572][INFO ][o.o.i.i.MetadataService  ] [MyWorkstation] Move metadata has finished.
[2022-08-20T21:03:33,166][INFO ][o.o.j.s.JobSweeper       ] [MyWorkstation] Running full sweep
[2022-08-20T21:08:33,168][INFO ][o.o.j.s.JobSweeper       ] [MyWorkstation] Running full sweep
[2022-08-20T21:13:33,169][INFO ][o.o.j.s.JobSweeper       ] [MyWorkstation] Running full sweep
jasonwee commented 2 years ago
done https://opensearch.org/docs/latest/ml-commons-plugin/index/
     https://opensearch.org/docs/latest/ml-commons-plugin/api
     https://opensearch.org/docs/latest/observability-plugin/ppl/commands#ad
     https://opensearch.org/docs/latest/observability-plugin/ppl/commands#kmeans
     https://opensearch.org/docs/latest/ml-commons-plugin/api#train-model
     https://opensearch.org/docs/latest/ml-commons-plugin/api#predict
     https://opensearch.org/docs/latest/ml-commons-plugin/api#train-and-predict
     https://opensearch.org/docs/latest/ml-commons-plugin/algorithms/