tataganesh
commented
10 months ago Did you try the instructions mentioned here - m-series-mac-users?
Open RobinHeitz opened 10 months ago
tataganesh
commented
10 months ago Did you try the instructions mentioned here - m-series-mac-users?
RobinHeitz
commented
10 months ago Well, no I did not, bc it was not mentioned in the getting started guides on the website.
However, it is not working like it should. I first started the command for launching the os.
marqo-os
Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
**************************************************************************
** This tool will be deprecated in the next major release of OpenSearch **
** https://github.com/opensearch-project/security/issues/1755 **
**************************************************************************
OpenSearch Security Demo Installer
** Warning: Do not use on production or public reachable systems **
Basedir: /usr/share/opensearch
OpenSearch install type: rpm/deb on NAME="Amazon Linux"
OpenSearch config dir: /usr/share/opensearch/config
OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
OpenSearch bin dir: /usr/share/opensearch/bin
OpenSearch plugins dir: /usr/share/opensearch/plugins
OpenSearch lib dir: /usr/share/opensearch/lib
Detected OpenSearch Version: x-content-2.4.0
Detected OpenSearch Security Version: 2.4.0.0
### Success
### Execute this script now on all your nodes and then start all nodes
### OpenSearch Security will be automatically initialized.
### If you like to change the runtime configuration
### change the files in ../../../config/opensearch-security and execute:
"/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh" -cd "/usr/share/opensearch/config/opensearch-security" -icl -key "/usr/share/opensearch/config/kirk-key.pem" -cert "/usr/share/opensearch/config/kirk.pem" -cacert "/usr/share/opensearch/config/root-ca.pem" -nhnv
### or run ./securityadmin_demo.sh
### To use the Security Plugin ConfigurationGUI
### To access your secured cluster open https://<hostname>:<HTTP port> and log in with admin/admin.
### (Ignore the SSL certificate warning because we installed self-signed demo certificates)
Enabling OpenSearch Security Plugin
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/opensearch/lib/opensearch-2.4.0.jar)
WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
WARNING: System::setSecurityManager will be removed in a future release
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/opensearch/lib/opensearch-2.4.0.jar)
WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
WARNING: System::setSecurityManager will be removed in a future release
[2024-01-04T19:41:57,910][INFO ][o.o.n.Node ] [e35b5491ef83] version[2.4.0], pid[102], build[tar/744ca260b892d119be8164f48d92b8810bd7801c/2022-11-15T04:47:22.592960163Z], OS[Linux/6.4.16-linuxkit/aarch64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.5/17.0.5+8]
[2024-01-04T19:41:57,911][INFO ][o.o.n.Node ] [e35b5491ef83] JVM home [/usr/share/opensearch/jdk], using bundled JDK [true]
[2024-01-04T19:41:57,911][INFO ][o.o.n.Node ] [e35b5491ef83] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-5592404725611734011, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=/usr/share/opensearch/config/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dopensearch.cgroups.hierarchy.override=/, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/usr/share/opensearch, -Dopensearch.path.conf=/usr/share/opensearch/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
[2024-01-04T19:41:58,338][WARN ][stderr ] [e35b5491ef83] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[2024-01-04T19:41:58,338][WARN ][stderr ] [e35b5491ef83] SLF4J: Defaulting to no-operation (NOP) logger implementation
[2024-01-04T19:41:58,338][WARN ][stderr ] [e35b5491ef83] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[2024-01-04T19:41:58,343][INFO ][o.o.s.s.t.SSLConfig ] [e35b5491ef83] SSL dual mode is disabled
[2024-01-04T19:41:58,343][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] OpenSearch Config path is /usr/share/opensearch/config
[2024-01-04T19:41:58,467][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] JVM supports TLSv1.3
[2024-01-04T19:41:58,468][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] Config directory is /usr/share/opensearch/config/, from there the key- and truststore files are resolved relatively
[2024-01-04T19:41:58,686][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] TLS Transport Client Provider : JDK
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] TLS Transport Server Provider : JDK
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] TLS HTTP Provider : JDK
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2]
[2024-01-04T19:41:58,687][INFO ][o.o.s.s.DefaultSecurityKeyStore] [e35b5491ef83] Enabled TLS protocols for HTTP layer : [TLSv1.3, TLSv1.2]
[2024-01-04T19:41:58,691][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Clustername: docker-cluster
[2024-01-04T19:41:58,695][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Directory /usr/share/opensearch/config has insecure file permissions (should be 0700)
[2024-01-04T19:41:58,695][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/esnode-key.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,695][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/root-ca.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,696][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/esnode.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,696][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/kirk.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,696][WARN ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] File /usr/share/opensearch/config/kirk-key.pem has insecure file permissions (should be 0600)
[2024-01-04T19:41:58,938][INFO ][o.o.p.c.PluginSettings ] [e35b5491ef83] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true, batch-metrics-retention-period-minutes: 7, rpc-port: 9650, webservice-port 9600
[2024-01-04T19:41:59,139][INFO ][o.o.i.r.ReindexPlugin ] [e35b5491ef83] ReindexPlugin reloadSPI called
[2024-01-04T19:41:59,139][INFO ][o.o.i.r.ReindexPlugin ] [e35b5491ef83] Unable to find any implementation for RemoteReindexExtension
[2024-01-04T19:41:59,161][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: reports-scheduler, index: .opendistro-reports-definitions
[2024-01-04T19:41:59,163][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: opendistro_anomaly_detector, index: .opendistro-anomaly-detector-jobs
[2024-01-04T19:41:59,163][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: opendistro-index-management, index: .opendistro-ism-config
[2024-01-04T19:41:59,172][INFO ][o.o.j.JobSchedulerPlugin ] [e35b5491ef83] Loaded scheduler extension: observability, index: .opensearch-observability-job
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [aggs-matrix-stats]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [analysis-common]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [geo]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [ingest-common]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [ingest-geoip]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [ingest-user-agent]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [lang-expression]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [lang-mustache]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [lang-painless]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [mapper-extras]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [opensearch-dashboards]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [parent-join]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [percolator]
[2024-01-04T19:41:59,174][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [rank-eval]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [reindex]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [repository-url]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [systemd]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded module [transport-netty4]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-alerting]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-anomaly-detection]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-asynchronous-search]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-cross-cluster-replication]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-geospatial]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-index-management]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-job-scheduler]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-knn]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-ml]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-neural-search]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-notifications]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-notifications-core]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-observability]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-performance-analyzer]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-reports-scheduler]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-security]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-security-analytics]
[2024-01-04T19:41:59,175][INFO ][o.o.p.PluginsService ] [e35b5491ef83] loaded plugin [opensearch-sql]
[2024-01-04T19:41:59,183][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in opensearch.yml
[2024-01-04T19:41:59,188][DEPRECATION][o.o.d.c.s.Settings ] [e35b5491ef83] [node.max_local_storage_nodes] setting was deprecated in OpenSearch and will be removed in a future release! See the breaking changes documentation for the next major version.
[2024-01-04T19:41:59,192][INFO ][o.o.e.NodeEnvironment ] [e35b5491ef83] using [1] data paths, mounts [[/ (overlay)]], net usable_space [46.3gb], net total_space [58.3gb], types [overlay]
[2024-01-04T19:41:59,192][INFO ][o.o.e.NodeEnvironment ] [e35b5491ef83] heap size [1gb], compressed ordinary object pointers [true]
[2024-01-04T19:41:59,207][INFO ][o.o.n.Node ] [e35b5491ef83] node name [e35b5491ef83], node ID [3LweFOgXSV27a2say6jGbg], cluster name [docker-cluster], roles [ingest, remote_cluster_client, data, cluster_manager]
[2024-01-04T19:42:00,657][WARN ][o.o.s.c.Salt ] [e35b5491ef83] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2024-01-04T19:42:00,674][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Message routing enabled: true
[2024-01-04T19:42:00,688][INFO ][o.o.s.f.SecurityFilter ] [e35b5491ef83] <NONE> indices are made immutable.
[2024-01-04T19:42:00,865][INFO ][o.o.a.b.ADCircuitBreakerService] [e35b5491ef83] Registered memory breaker.
[2024-01-04T19:42:01,157][INFO ][o.o.m.c.b.MLCircuitBreakerService] [e35b5491ef83] Registered ML memory breaker.
[2024-01-04T19:42:01,157][INFO ][o.o.m.c.b.MLCircuitBreakerService] [e35b5491ef83] Registered ML disk breaker.
[2024-01-04T19:42:01,225][INFO ][o.r.Reflections ] [e35b5491ef83] Reflections took 34 ms to scan 1 urls, producing 12 keys and 32 values
[2024-01-04T19:42:01,426][INFO ][o.o.t.NettyAllocator ] [e35b5491ef83] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=1gb}]
[2024-01-04T19:42:01,481][INFO ][o.o.d.DiscoveryModule ] [e35b5491ef83] using discovery type [single-node] and seed hosts providers [settings]
[2024-01-04T19:42:01,710][WARN ][o.o.g.DanglingIndicesState] [e35b5491ef83] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2024-01-04T19:42:01,904][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [e35b5491ef83] PerformanceAnalyzer Enabled: false
[2024-01-04T19:42:01,919][INFO ][o.o.n.Node ] [e35b5491ef83] initialized
[2024-01-04T19:42:01,919][INFO ][o.o.n.Node ] [e35b5491ef83] starting ...
[2024-01-04T19:42:01,973][INFO ][o.o.t.TransportService ] [e35b5491ef83] publish_address {172.17.0.2:9300}, bound_addresses {0.0.0.0:9300}
[2024-01-04T19:42:02,046][INFO ][o.o.c.c.Coordinator ] [e35b5491ef83] setting initial configuration to VotingConfiguration{3LweFOgXSV27a2say6jGbg}
[2024-01-04T19:42:02,153][INFO ][o.o.c.s.MasterService ] [e35b5491ef83] elected-as-cluster-manager ([1] nodes joined)[{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_CLUSTER_MANAGER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: cluster-manager node changed {previous [], current [{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}]}
[2024-01-04T19:42:02,166][INFO ][o.o.c.c.CoordinationState] [e35b5491ef83] cluster UUID set to [ZhevNRdGSO61W07y-GMbjw]
[2024-01-04T19:42:02,176][INFO ][o.o.c.s.ClusterApplierService] [e35b5491ef83] cluster-manager node changed {previous [], current [{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
[2024-01-04T19:42:02,179][INFO ][o.o.a.c.ADClusterEventListener] [e35b5491ef83] Cluster is not recovered yet.
[2024-01-04T19:42:02,181][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,190][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Cache cluster manager node onClusterManager time: 1704397322190
[2024-01-04T19:42:02,194][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [e35b5491ef83] Config override setting update called with empty string. Ignoring.
[2024-01-04T19:42:02,197][INFO ][o.o.d.PeerFinder ] [e35b5491ef83] setting findPeersInterval to [1s] as node commission status = [true] for local node [{e35b5491ef83}{3LweFOgXSV27a2say6jGbg}{AfiUC2e3TVCkzUQSnnJCvA}{172.17.0.2}{172.17.0.2:9300}{dimr}{shard_indexing_pressure_enabled=true}]
[2024-01-04T19:42:02,199][INFO ][o.o.h.AbstractHttpServerTransport] [e35b5491ef83] publish_address {172.17.0.2:9200}, bound_addresses {0.0.0.0:9200}
[2024-01-04T19:42:02,199][INFO ][o.o.n.Node ] [e35b5491ef83] started
[2024-01-04T19:42:02,200][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] Node started
[2024-01-04T19:42:02,200][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Will attempt to create index .opendistro_security and default configs if they are absent
[2024-01-04T19:42:02,200][INFO ][o.o.s.OpenSearchSecurityPlugin] [e35b5491ef83] 0 OpenSearch Security modules loaded so far: []
[2024-01-04T19:42:02,200][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Background init thread started. Install default config?: true
[2024-01-04T19:42:02,205][INFO ][o.o.a.c.HashRing ] [e35b5491ef83] Node added: [3LweFOgXSV27a2say6jGbg]
[2024-01-04T19:42:02,206][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,207][INFO ][o.o.a.c.HashRing ] [e35b5491ef83] Add data node to AD version hash ring: 3LweFOgXSV27a2say6jGbg
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.HashRing ] [e35b5491ef83] All nodes with known AD version: {3LweFOgXSV27a2say6jGbg=ADNodeInfo{version=2.4.0, isEligibleDataNode=true}}
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.HashRing ] [e35b5491ef83] Rebuild AD hash ring for realtime AD with cooldown, nodeChangeEvents size 0
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.HashRing ] [e35b5491ef83] Build AD version hash ring successfully
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.ADDataMigrator ] [e35b5491ef83] Start migrating AD data
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.ADDataMigrator ] [e35b5491ef83] AD job index doesn't exist, no need to migrate
[2024-01-04T19:42:02,208][INFO ][o.o.a.c.ADClusterEventListener] [e35b5491ef83] Init AD version hash ring successfully
[2024-01-04T19:42:02,218][INFO ][o.o.g.GatewayService ] [e35b5491ef83] recovered [0] indices into cluster_state
[2024-01-04T19:42:02,262][INFO ][o.o.c.m.MetadataCreateIndexService] [e35b5491ef83] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1]
[2024-01-04T19:42:02,267][INFO ][o.o.c.r.a.AllocationService] [e35b5491ef83] updating number_of_replicas to [0] for indices [.opendistro_security]
[2024-01-04T19:42:02,307][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,443][INFO ][o.o.c.r.a.AllocationService] [e35b5491ef83] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]]]).
[2024-01-04T19:42:02,466][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,467][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Index .opendistro_security created?: true
[2024-01-04T19:42:02,467][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Node started, try to initialize it. Wait for at least yellow cluster state....
[2024-01-04T19:42:02,472][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'config' with /usr/share/opensearch/config/opensearch-security/config.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,527][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] create_mapping
[2024-01-04T19:42:02,538][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,574][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'config' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,574][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'roles' with /usr/share/opensearch/config/opensearch-security/roles.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,583][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,594][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,606][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'roles' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,606][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'rolesmapping' with /usr/share/opensearch/config/opensearch-security/roles_mapping.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,614][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,624][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,631][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'rolesmapping' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,631][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'internalusers' with /usr/share/opensearch/config/opensearch-security/internal_users.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,639][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,652][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,665][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'internalusers' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,665][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'actiongroups' with /usr/share/opensearch/config/opensearch-security/action_groups.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,680][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,694][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,705][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'actiongroups' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,705][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'tenants' with /usr/share/opensearch/config/opensearch-security/tenants.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,712][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,724][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,731][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'tenants' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,731][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'nodesdn' with /usr/share/opensearch/config/opensearch-security/nodes_dn.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2024-01-04T19:42:02,737][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,747][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,755][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'nodesdn' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,755][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'whitelist' with /usr/share/opensearch/config/opensearch-security/whitelist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2024-01-04T19:42:02,761][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,771][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,777][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'whitelist' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,777][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'allowlist' with /usr/share/opensearch/config/opensearch-security/allowlist.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=true
[2024-01-04T19:42:02,783][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,793][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,800][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'allowlist' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,800][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Will update 'audit' with /usr/share/opensearch/config/opensearch-security/audit.yml and populate it with empty doc if file missing and populateEmptyIfFileMissing=false
[2024-01-04T19:42:02,813][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [.opendistro_security/8-MM67BuShKyQF81ynA3rQ] update_mapping [_doc]
[2024-01-04T19:42:02,824][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:42:02,830][INFO ][o.o.s.s.ConfigHelper ] [e35b5491ef83] Doc with id 'audit' and version 2 is updated in .opendistro_security index.
[2024-01-04T19:42:02,914][INFO ][stdout ] [e35b5491ef83] [FINE] No subscribers registered for event class org.opensearch.security.securityconf.DynamicConfigFactory$NodesDnModelImpl
[2024-01-04T19:42:02,914][INFO ][stdout ] [e35b5491ef83] [FINE] No subscribers registered for event class org.greenrobot.eventbus.NoSubscriberEvent
[2024-01-04T19:42:02,914][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing on REST API is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from REST API auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing on Transport API is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] [AUTHENTICATED, GRANTED_PRIVILEGES] are excluded from Transport API auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing of request body is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Bulk requests resolution is disabled during request auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Index resolution is enabled during request auditing.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Sensitive headers auditing is enabled.
[2024-01-04T19:42:02,915][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing requests from kibanaserver users is disabled.
[2024-01-04T19:42:02,916][WARN ][o.o.s.a.r.AuditMessageRouter] [e35b5491ef83] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing of external configuration is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing of internal configuration is enabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing only metadata information for read request is enabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing will watch {} for read requests.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing read operation requests from kibanaserver users is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing only metadata information for write request is enabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing diffs for write requests is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing write operation requests from kibanaserver users is disabled.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Auditing will watch <NONE> for write requests.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] .opendistro_security is used as internal security index.
[2024-01-04T19:42:02,917][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Internal index used for posting audit logs is null
[2024-01-04T19:42:02,917][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Hot-reloading of audit configuration is enabled
[2024-01-04T19:42:02,917][INFO ][o.o.s.c.ConfigurationRepository] [e35b5491ef83] Node 'e35b5491ef83' initialized
[2024-01-04T19:43:02,209][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Performing ISM template migration.
[2024-01-04T19:43:02,218][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Doing ISM template migration 1 time.
[2024-01-04T19:43:02,220][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Use 2024-01-04T18:42:02.190Z as migrating ISM template last_updated_time
[2024-01-04T19:43:02,231][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] ISM templates: {}
[2024-01-04T19:43:02,232][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Policies to update: []
[2024-01-04T19:43:02,239][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Performing move cluster state metadata.
[2024-01-04T19:43:02,242][INFO ][o.o.i.i.MetadataService ] [e35b5491ef83] ISM config index not exist, so we cancel the metadata migration job.
[2024-01-04T19:43:02,264][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Failure experienced when migrating ISM Template and update ISM policies: {}
[2024-01-04T19:43:02,301][INFO ][o.o.c.s.ClusterSettings ] [e35b5491ef83] updating [plugins.index_state_management.template_migration.control] from [0] to [-1]
[2024-01-04T19:43:02,302][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:43:02,305][INFO ][o.o.i.i.m.ISMTemplateService] [e35b5491ef83] Successfully update template migration setting
[2024-01-04T19:44:02,245][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Cancel background move metadata process.
[2024-01-04T19:44:02,255][INFO ][o.o.i.i.ManagedIndexCoordinator] [e35b5491ef83] Performing move cluster state metadata.
[2024-01-04T19:44:02,255][INFO ][o.o.i.i.MetadataService ] [e35b5491ef83] Move metadata has finished.
[2024-01-04T19:44:25,843][DEPRECATION][o.o.d.c.m.IndexNameExpressionResolver] [e35b5491ef83] this request accesses system indices: [.opendistro_security], but in a future major version, direct access to system indices will be prevented by default
[2024-01-04T19:44:25,866][INFO ][o.o.c.m.MetadataCreateIndexService] [e35b5491ef83] [security-auditlog-2024.01.04] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[2024-01-04T19:44:25,904][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:44:25,937][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
[2024-01-04T19:44:25,954][INFO ][o.o.c.m.MetadataMappingService] [e35b5491ef83] [security-auditlog-2024.01.04/exXVsEpaRNiq97mAv5HfLg] create_mapping
[2024-01-04T19:44:25,965][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [e35b5491ef83] Detected cluster change event for destination migration
^CKilling opensearch process 102
[2024-01-04T19:46:40,561][INFO ][o.o.n.Node ] [e35b5491ef83] stopping ...
[2024-01-04T19:46:40,561][INFO ][o.o.s.a.r.AuditMessageRouter] [e35b5491ef83] Closing AuditMessageRouter
[2024-01-04T19:46:40,571][INFO ][o.o.s.a.s.SinkProvider ] [e35b5491ef83] Closing InternalOpenSearchSink
[2024-01-04T19:46:40,572][INFO ][o.o.s.a.s.SinkProvider ] [e35b5491ef83] Closing DebugSink
[2024-01-04T19:46:40,705][INFO ][o.o.n.Node ] [e35b5491ef83] stopped
[2024-01-04T19:46:40,705][INFO ][o.o.n.Node ] [e35b5491ef83] closing ...
[2024-01-04T19:46:40,731][INFO ][o.o.s.a.i.AuditLogImpl ] [e35b5491ef83] Closing AuditLogImpl
[2024-01-04T19:46:40,741][INFO ][o.o.n.Node ] [e35b5491ef83] closed
Killing performance analyzer process 103
OpenSearch exited with code 130
Performance analyzer exited with code 143
After 2 minutes then the second container but it terminates:
marqo
Found Marqo-OS URL. Skipping internal Marqo-OS configuration.
Starting Marqo throttling...
Marqo throttling successfully started.
/usr/local/lib/python3.8/dist-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
warn(f"Failed to load image Python extension: {e}")
INFO:ModelsForStartup:pre-loading ['hf/all_datasets_v4_MiniLM-L6', 'ViT-L/14'] onto devices=['cpu']
INFO:DeviceSummary:found devices [{'id': -1, 'name': ['cpu']}]
INFO:SetBestAvailableDevice:Best available device set to: cpu
config.json: 0%| | 0.00/612 [00:00<?, ?B/s]
###########################################################
###########################################################
###### STARTING DOWNLOAD OF MARQO ARTEFACTS################
###########################################################
###########################################################
loading for: model_name=hf/all_datasets_v4_MiniLM-L6 and properties={'name': 'flax-sentence-embeddings/all_datasets_v4_MiniLM-L6', 'dimensions': 384, 'tokens': 128, 'type': 'hf', 'notes': ''}
config.json: 100%|██████████| 612/612 [00:00<00:00, 84.8kB/s]
pytorch_model.bin: 100%|██████████| 90.9M/90.9M [00:07<00:00, 12.9MB/s]
tokenizer_config.json: 100%|██████████| 535/535 [00:00<00:00, 268kB/s]
vocab.txt: 100%|██████████| 232k/232k [00:00<00:00, 1.20MB/s]
tokenizer.json: 100%|██████████| 466k/466k [00:00<00:00, 4.08MB/s]
special_tokens_map.json: 100%|██████████| 112/112 [00:00<00:00, 151kB/s]
INFO:marqo.s2_inference.s2_inference:loaded hf/all_datasets_v4_MiniLM-L6 on device cpu with normalization=True at time=2024-01-04 19:44:25.862665.
INFO:ModelsForStartup:hf/all_datasets_v4_MiniLM-L6 cpu run succesfully!
loading for: model_name=ViT-L/14 and properties={'name': 'ViT-L/14', 'dimensions': 768, 'notes': 'CLIP ViT-L/14', 'type': 'clip'}
100%|███████████████████████████████████████| 890M/890M [01:12<00:00, 12.9MiB/s]./run_marqo.sh: line 161: 19 Killed uvicorn api:app --host 0.0.0.0 --port 8882 --timeout-keep-alive 75 --log-level $MARQO_LOG_LEVEL
It should be the webserver for the db right? Thanks :)
AlbertoLanaro
commented
9 months ago Same problem here, with version 2.1.0. Cannot run docker container on Mac M1 (Sonoma 14.0).
After successfully pulling the image, if I run the command:
$ docker run --name marqo -it -p 8882:8882 marqoai/marqo:2.1.0I got this error:
External vector store not configured. Using local vector store
Waiting for vector store to start
Warning: Failed to configure local vector store. Marqo may not function correctly
Starting Marqo throttling
Called Marqo throttling start command
Marqo throttling is now running
/usr/local/lib64/python3.8/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
warn(f"Failed to load image Python extension: {e}")
/usr/local/lib/python3.8/site-packages/transformers/generation_utils.py:24: FutureWarning: Importing `GenerationMixin` from `src/transformers/generation_utils.py` is deprecated and will be removed in Transformers v5. Import as `from transformers import GenerationMixin` instead.
warnings.warn(
INFO:ModelsForStartup:pre-loading ['hf/e5-base-v2', 'open_clip/ViT-B-32/laion2b_s34b_b79k'] onto devices=['cpu']
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions
yield
File "/usr/local/lib/python3.8/site-packages/httpcore/_backends/sync.py", line 212, in connect_tcp
sock = socket.create_connection(
File "/usr/lib64/python3.8/socket.py", line 808, in create_connection
raise err
File "/usr/lib64/python3.8/socket.py", line 796, in create_connection
sock.connect(sa)
OSError: [Errno 99] Cannot assign requested address
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 66, in map_httpcore_exceptions
yield
File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 228, in handle_request
resp = self._pool.handle_request(req)
File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection_pool.py", line 262, in handle_request
raise exc
File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection_pool.py", line 245, in handle_request
response = connection.handle_request(request)
File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 99, in handle_request
raise exc
File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 76, in handle_request
stream = self._connect(request)
File "/usr/local/lib/python3.8/site-packages/httpcore/_sync/connection.py", line 124, in _connect
stream = self._network_backend.connect_tcp(**kwargs)
File "/usr/local/lib/python3.8/site-packages/httpcore/_backends/sync.py", line 219, in connect_tcp
sock.setsockopt(socket.IPPROTO_TCP, socket.TCP_NODELAY, 1)
File "/usr/lib64/python3.8/contextlib.py", line 131, in __exit__
self.gen.throw(type, value, traceback)
File "/usr/local/lib/python3.8/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc) from exc
httpcore.ConnectError: [Errno 99] Cannot assign requested address
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/bin/uvicorn", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/uvicorn/main.py", line 416, in main
run(
File "/usr/local/lib/python3.8/site-packages/uvicorn/main.py", line 587, in run
server.run()
File "/usr/local/lib/python3.8/site-packages/uvicorn/server.py", line 61, in run
return asyncio.run(self.serve(sockets=sockets))
File "/usr/lib64/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
File "/usr/local/lib/python3.8/site-packages/uvicorn/server.py", line 68, in serve
config.load()
File "/usr/local/lib/python3.8/site-packages/uvicorn/config.py", line 467, in load
self.loaded_app = import_from_string(self.app)
File "/usr/local/lib/python3.8/site-packages/uvicorn/importer.py", line 21, in import_from_string
module = importlib.import_module(module_str)
File "/usr/lib64/python3.8/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 843, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/app/src/marqo/tensor_search/api.py", line 50, in <module>
on_start(_config)
File "/app/src/marqo/tensor_search/on_start_script.py", line 36, in on_start
thing_to_start.run()
File "/app/src/marqo/tensor_search/on_start_script.py", line 48, in run
created = self.config.index_management.bootstrap_vespa()
File "/app/src/marqo/core/index_management/index_management.py", line 64, in bootstrap_vespa
app = self.vespa_client.download_application()
File "/app/src/marqo/vespa/vespa_client.py", line 103, in download_application
session_id = self._create_deploy_session(httpx_client)
File "/app/src/marqo/vespa/vespa_client.py", line 473, in _create_deploy_session
response = httpx_client.post(endpoint)
File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 1132, in post
return self.request(
File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 814, in request
return self.send(request, auth=auth, follow_redirects=follow_redirects)
File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 901, in send
response = self._send_handling_auth(
File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 929, in _send_handling_auth
response = self._send_handling_redirects(
File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 966, in _send_handling_redirects
response = self._send_single_request(request)
File "/usr/local/lib/python3.8/site-packages/httpx/_client.py", line 1002, in _send_single_request
response = transport.handle_request(request)
File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 228, in handle_request
resp = self._pool.handle_request(req)
File "/usr/lib64/python3.8/contextlib.py", line 131, in __exit__
self.gen.throw(type, value, traceback)
File "/usr/local/lib/python3.8/site-packages/httpx/_transports/default.py", line 83, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ConnectError: [Errno 99] Cannot assign requested address
suprateembanerjee
commented
7 months ago Same issue. Where are the instructions for M series macs?
Describe the bug I cannot run the docker image on my M1 Mac. It does work under Ubuntu as expected.
Using this command from the docs:
docker run --name marqo -it --privileged -p 8882:8882 --add-host host.docker.internal:host-gateway marqoai/marqo:latestYields:
Docker not found. Installing it... bash: /app/dind_setup/setup_dind.sh: No such file or directory Preparing to start Marqo-OS... Preparing to start Marqo-OS... Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS... rm: cannot remove '/var/run/docker.pid': No such file or directory Preparing to start Marqo-OS...
To test my docker desktop locally, I've successfully ran hello-world and python:latest images. They worked.
To Reproduce Steps to reproduce the behavior:
docker run --name marqo -it --privileged -p 8882:8882 --add-host host.docker.internal:host-gateway marqoai/marqo:lateston M1 MacExpected behavior Expect it to launch, like it does on my ubuntu machines.
Desktop (please complete the following information):
Thanks!