search

magneticio / vamp2setup

Vamp Lamia Alpha Setup Guide
Apache License 2.0
33 stars 4 forks source link

samples not work #15

Closed wansuiye closed 5 years ago

wansuiye commented 6 years ago

hi, i try 0.2.2 realease and the master branch in my private cloud, i just edit the mongo volumes from pvc to hostpath and replicas is 1 beacause i donot have a pv local. however when i create the samples/namespace.yaml, it can not seen in the web ui and no extra log in vamp pod. it seems that vamp doesn't listen "vamp-managed:true"

istio:0.8.0 kubernetes:1.9

thanks~

avalcepina commented 6 years ago

Hi, are you trying on an empty cluster or do you already have istio installed? In case you don't have Istio, does it get installed correctly by Lamia? Are you getting any notifications from the ui?

If Istio is not initialized, new namespaces will not be imported. Also can you please try with 0.3.0 ?

wansuiye commented 6 years ago

@avalcepina hi, istio has installed and work well. the ui can create user and role, so i think the mongo also works well. when create namespace or deployment, can not get any notifications from ui and not any extra log from web pod. namespace istio-system has been labeled with vamp...

in addition the istio is reinstalled, but the logging-stack has been installed.

i also try with 0.3.0, however it can not work.

below is the vamp log and istio-initializer log

09:24:08.634 [main] INFO  io.vamp.Main$ - Loading desiredstates kubernetes, Unquoted("io.vamp.states.impl.DesiredStatesImpl")
09:24:08.701 [main] INFO  io.vamp.persistence.Storage$ - Service Name { 'service name' : 'vamp-hazelcast' 
Jul 25, 2018 9:24:08 AM com.hazelcast.instance.AddressPicker
INFO: [LOCAL] [vamp-group] [3.9.1] Prefer IPv4 stack is true.
Jul 25, 2018 9:24:08 AM com.hazelcast.instance.AddressPicker
INFO: [LOCAL] [vamp-group] [3.9.1] Picked [10.20.30.198]:5701, using socket ServerSocket[addr=/0.0.0.0,localport=5701], bind any local is true
Jul 25, 2018 9:24:08 AM com.hazelcast.system
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Hazelcast 3.9.1 (20171130 - feca534) starting at [10.20.30.198]:5701
Jul 25, 2018 9:24:08 AM com.hazelcast.system
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Copyright (c) 2008-2017, Hazelcast, Inc. All Rights Reserved.
Jul 25, 2018 9:24:08 AM com.hazelcast.system
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Configured Hazelcast Serialization version: 1
Jul 25, 2018 9:24:09 AM com.hazelcast.spi.impl.operationservice.impl.BackpressureRegulator
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Backpressure is disabled
Jul 25, 2018 9:24:09 AM com.hazelcast.spi.discovery.integration.DiscoveryService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Kubernetes Discovery properties: { service-dns: null, service-dns-timeout: 5, service-name: vamp-hazelcast, service-label: null, service-label-value: true, namespace: vamp-system, resolve-not-ready-addresses: false, kubernetes-master: https://kubernetes.default.svc}
Jul 25, 2018 9:24:09 AM com.hazelcast.spi.discovery.integration.DiscoveryService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Kubernetes Discovery: Bearer Token { eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJ2YW1wLXN5c3RlbSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJkZWZhdWx0LXRva2VuLWptN25tIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQubmFtZSI6ImRlZmF1bHQiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiI3YTI3YWEzZS04ZmVjLTExZTgtOWU5Zi02YzkyYmY2M2U4MGQiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6dmFtcC1zeXN0ZW06ZGVmYXVsdCJ9.WHdbBemmxASSb8Ow2SGWuJCRdte6xznyJKRH-W3fmWWtxNHfzlk1omSBwHJhBKRR0S0DNc8Q8ajHy49QrJtql_sdINNYPd49w0AbENZjmutaxoq1bgHYxZXaUBZ4ianzTpbBv3WzbJpNtYR2bfgYQ9MycthsCfP9iBlczQRhb2-WYV1fwiH-YIk2TaXImzAPLFhWrEAfv8Gby88254leRvAtQxLKIwc-veFItdRYgImof_vajWQwkAdYmrSTN8WCdFe_3vPOwNypMttIwCsMsdgsffoSqazBHfjVdEvbibOnzRQTM0o68Iq-u2YhQ3HDQLQu0e0J6DJX4F2PmRP3Sg }
09:24:09.489 [main] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from Kubernetes config...
09:24:09.500 [main] DEBUG io.fabric8.kubernetes.client.Config - Did not find Kubernetes config at: [/home/app/.kube/config]. Ignoring.
09:24:09.500 [main] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from service account...
09:24:09.500 [main] DEBUG io.fabric8.kubernetes.client.Config - Found service account host and port: 192.168.254.1:443
09:24:09.500 [main] DEBUG io.fabric8.kubernetes.client.Config - Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt].
09:24:09.505 [main] DEBUG io.fabric8.kubernetes.client.Config - Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token].
09:24:09.506 [main] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client namespace from Kubernetes service account namespace path...
09:24:09.506 [main] DEBUG io.fabric8.kubernetes.client.Config - Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace].
Jul 25, 2018 9:24:09 AM com.hazelcast.spi.discovery.integration.DiscoveryService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Kubernetes Discovery activated resolver: ServiceEndpointResolver
Jul 25, 2018 9:24:09 AM com.hazelcast.instance.Node
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Activating Discovery SPI Joiner
Jul 25, 2018 9:24:09 AM com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Starting 48 partition threads and 25 generic threads (1 dedicated for priority tasks)
Jul 25, 2018 9:24:09 AM com.hazelcast.internal.diagnostics.Diagnostics
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
Jul 25, 2018 9:24:09 AM com.hazelcast.core.LifecycleService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] [10.20.30.198]:5701 is STARTING
Jul 25, 2018 9:24:15 AM com.hazelcast.system
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Cluster version set to 3.9
Jul 25, 2018 9:24:15 AM com.hazelcast.internal.cluster.ClusterService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] 

Members {size:1, ver:1} [
    Member [10.20.30.198]:5701 - 5e6565c0-3a79-4280-b4d2-82569dc74f67 this
]

Jul 25, 2018 9:24:15 AM com.hazelcast.core.LifecycleService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] [10.20.30.198]:5701 is STARTED
Jul 25, 2018 9:24:15 AM com.hazelcast.internal.partition.impl.PartitionStateManager
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Initializing cluster partition table arrangement...
09:24:15.561 [main] INFO  io.vamp.Main$ - Loading containerdriver kubernetes, Unquoted("io.vamp.drivers.impl.kubernetes.KubernetesContainerDriverFactory")
09:24:15.562 [main] INFO  io.vamp.Main$ - Loading currentstates kubernetes, Unquoted("io.vamp.states.impl.CurrentStatesImpl")
09:24:15.563 [main] INFO  io.vamp.Main$ - Loading networkdriver istio, Unquoted("io.vamp.drivers.impl.istio.IstioNetworkDriver")
09:24:15.563 [main] INFO  io.vamp.Main$ - Loading policies MetricVirtualServiceCanaryReleasingPolicy, Unquoted("io.vamp.policies.impl.virtualservice.MetricVirtualServiceCanaryReleasingPolicy")
09:24:15.564 [main] INFO  io.vamp.Main$ - Loading policies TimedCanaryReleasingPolicy, Unquoted("io.vamp.policies.impl.virtualservice.TimedCanaryReleasingPolicy")
09:24:15.564 [main] INFO  io.vamp.Main$ - Loading policies CustomVirtualServiceCanaryReleasingPolicy, Unquoted("io.vamp.policies.impl.virtualservice.CustomVirtualServiceCanaryReleasingPolicy")
09:24:15.565 [main] INFO  io.vamp.Main$ - Loading policies HealthBasedVirtualServiceCanaryReleasingPolicy, Unquoted("io.vamp.policies.impl.virtualservice.HealthBasedVirtualServiceCanaryReleasingPolicy")
09:24:15.565 [main] INFO  io.vamp.Main$ - Loading policies ExperimentDrivenCanaryReleasingPolicy, Unquoted("io.vamp.policies.impl.virtualservice.ExperimentDrivenCanaryReleasingPolicy")
09:24:15.566 [main] INFO  io.vamp.Main$ - Loading persistence mongodb, Unquoted("io.vamp.drivers.imp.MongoDbPersistenceDriver")
09:24:15.566 [main] INFO  io.vamp.Main$ - Loading executors DefaultRootPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultRootPolicyExecutor")
09:24:15.567 [main] INFO  io.vamp.Main$ - Loading executors DefaultDeploymentPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultDeploymentPolicyExecutor")
09:24:15.567 [main] INFO  io.vamp.Main$ - Loading executors DefaultGatewayPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultGatewayPolicyExecutor")
09:24:15.568 [main] INFO  io.vamp.Main$ - Loading executors ReadOnlyApplicationPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.ReadOnlyApplicationPolicyExecutor")
09:24:15.568 [main] INFO  io.vamp.Main$ - Loading executors DefaultServiceEntryPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultServiceEntryPolicyExecutor")
09:24:15.568 [main] INFO  io.vamp.Main$ - Loading executors NoActionPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.NoActionPolicyExecutor")
09:24:15.569 [main] INFO  io.vamp.Main$ - Loading executors ReadOnlyDeploymentPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.ReadOnlyDeploymentPolicyExecutor")
09:24:15.569 [main] INFO  io.vamp.Main$ - Loading executors DefaultVirtualServicePolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultVirtualServicePolicyExecutor")
09:24:15.569 [main] INFO  io.vamp.Main$ - Loading executors ReadOnlyVirtualClusterPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.ReadOnlyVirtualClusterPolicyExecutor")
09:24:15.570 [main] INFO  io.vamp.Main$ - Loading executors DefaultDestinationRulePolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultDestinationRulePolicyExecutor")
09:24:15.571 [main] INFO  io.vamp.Main$ - Loading executors DefaultExperimentPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultExperimentPolicyExecutor")
09:24:15.571 [main] INFO  io.vamp.Main$ - Loading executors IstioSetupClusterPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.IstioSetupClusterPolicyExecutor")
09:24:15.572 [main] INFO  io.vamp.Main$ - Loading executors DefaultClusterPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultClusterPolicyExecutor")
09:24:15.572 [main] INFO  io.vamp.Main$ - Loading executors DefaultVirtualClusterPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultVirtualClusterPolicyExecutor")
09:24:15.572 [main] INFO  io.vamp.Main$ - Loading executors DefaultServicePolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultServicePolicyExecutor")
09:24:15.573 [main] INFO  io.vamp.Main$ - Loading executors DefaultApplicationPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultApplicationPolicyExecutor")
09:24:15.573 [main] INFO  io.vamp.Main$ - Loading executors DefaultProjectPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultProjectPolicyExecutor")
09:24:15.573 [main] INFO  io.vamp.Main$ - Loading executors DefaultIngressPolicyExecutor, Unquoted("io.vamp.policies.executors.impl.DefaultIngressPolicyExecutor")
09:24:15.574 [main] INFO  io.vamp.Main$ - Loading routeruledriver istio, Unquoted("io.vamp.drivers.impl.istio.IstioRouteRuleDriver")
09:24:15.574 [main] INFO  io.vamp.Main$ - Loading notificationdriver istio, Unquoted("io.vamp.drivers.impl.DefaultNotificationDriver")
09:24:15.575 [main] INFO  io.vamp.Main$ - Loading metricsdriver prometheus, Unquoted("io.vamp.drivers.impl.prometheus.IstioMetricsDriver")
09:24:15.985 [main] DEBUG io.vamp.persistence.Storage$ - Init storage with name: main
09:24:16.537 [main] INFO  io.vamp.Main$ - Service is listening at 0.0.0.0:8888
09:24:16.537 [main] INFO  io.vamp.Main$ - running as in clutser mode
09:24:16.591 [main] WARN  io.vamp.states.DesiredStates$ - Desired States not configured for  . using default implementation
09:24:16.647 [hz.main.cached.thread-3] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'user' }
09:24:16.837 [hz.main.cached.thread-3] INFO  org.mongodb.driver.cluster - Cluster created with settings {hosts=[mongo-0.vamp-mongodb:27017, mongo-1.vamp-mongodb:27017, mongo-2.vamp-mongodb:27017], mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
09:24:16.838 [hz.main.cached.thread-3] INFO  org.mongodb.driver.cluster - Adding discovered server mongo-0.vamp-mongodb:27017 to client view of cluster
09:24:16.860 [hz.main.cached.thread-3] INFO  org.mongodb.driver.cluster - Adding discovered server mongo-1.vamp-mongodb:27017 to client view of cluster
09:24:16.861 [hz.main.cached.thread-3] INFO  org.mongodb.driver.cluster - Adding discovered server mongo-2.vamp-mongodb:27017 to client view of cluster
09:24:16.863 [hz.main.cached.thread-3] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=UNKNOWN, servers=[{address=mongo-2.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}, {address=mongo-0.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}, {address=mongo-1.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}]
09:24:16.866 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-2.vamp-mongodb:27017] DEBUG org.mongodb.driver.connection - Closing connection connectionId{localValue:1}
09:24:16.866 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-1.vamp-mongodb:27017] DEBUG org.mongodb.driver.connection - Closing connection connectionId{localValue:3}
09:24:16.869 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-2.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Exception in monitor thread while connecting to server mongo-2.vamp-mongodb:27017
com.mongodb.MongoSocketException: mongo-2.vamp-mongodb: Name does not resolve
    at com.mongodb.ServerAddress.getSocketAddress(ServerAddress.java:188)
    at com.mongodb.connection.SocketStreamHelper.initialize(SocketStreamHelper.java:59)
    at com.mongodb.connection.SocketStream.open(SocketStream.java:57)
    at com.mongodb.connection.InternalStreamConnection.open(InternalStreamConnection.java:107)
    at com.mongodb.connection.DefaultServerMonitor$ServerMonitorRunnable.run(DefaultServerMonitor.java:111)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.UnknownHostException: mongo-2.vamp-mongodb: Name does not resolve
    at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
    at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
    at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
    at java.net.InetAddress.getAllByName(InetAddress.java:1192)
    at java.net.InetAddress.getAllByName(InetAddress.java:1126)
    at java.net.InetAddress.getByName(InetAddress.java:1076)
    at com.mongodb.ServerAddress.getSocketAddress(ServerAddress.java:186)
    ... 5 common frames omitted
09:24:16.869 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-1.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Exception in monitor thread while connecting to server mongo-1.vamp-mongodb:27017
com.mongodb.MongoSocketException: mongo-1.vamp-mongodb: Name does not resolve
    at com.mongodb.ServerAddress.getSocketAddress(ServerAddress.java:188)
    at com.mongodb.connection.SocketStreamHelper.initialize(SocketStreamHelper.java:59)
    at com.mongodb.connection.SocketStream.open(SocketStream.java:57)
    at com.mongodb.connection.InternalStreamConnection.open(InternalStreamConnection.java:107)
    at com.mongodb.connection.DefaultServerMonitor$ServerMonitorRunnable.run(DefaultServerMonitor.java:111)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.UnknownHostException: mongo-1.vamp-mongodb: Name does not resolve
    at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
    at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
    at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
    at java.net.InetAddress.getAllByName(InetAddress.java:1192)
    at java.net.InetAddress.getAllByName(InetAddress.java:1126)
    at java.net.InetAddress.getByName(InetAddress.java:1076)
    at com.mongodb.ServerAddress.getSocketAddress(ServerAddress.java:186)
    ... 5 common frames omitted
09:24:16.871 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-2.vamp-mongodb:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=UNKNOWN, servers=[{address=mongo-2.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketException: mongo-2.vamp-mongodb: Name does not resolve}, caused by {java.net.UnknownHostException: mongo-2.vamp-mongodb: Name does not resolve}}, {address=mongo-0.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}, {address=mongo-1.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}]
09:24:16.871 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-1.vamp-mongodb:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=UNKNOWN, servers=[{address=mongo-2.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketException: mongo-2.vamp-mongodb: Name does not resolve}, caused by {java.net.UnknownHostException: mongo-2.vamp-mongodb: Name does not resolve}}, {address=mongo-0.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}, {address=mongo-1.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketException: mongo-1.vamp-mongodb: Name does not resolve}, caused by {java.net.UnknownHostException: mongo-1.vamp-mongodb: Name does not resolve}}]
09:24:16.883 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.connection - Opened connection [connectionId{localValue:2, serverValue:4}] to mongo-0.vamp-mongodb:27017
09:24:16.883 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb:27017
09:24:16.884 [hz.main.cached.thread-3] INFO  org.mongodb.driver.cluster - No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=UNKNOWN, connectionMode=MULTIPLE, serverDescriptions=[ServerDescription{address=mongo-2.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketException: mongo-2.vamp-mongodb: Name does not resolve}, caused by {java.net.UnknownHostException: mongo-2.vamp-mongodb: Name does not resolve}}, ServerDescription{address=mongo-0.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING}, ServerDescription{address=mongo-1.vamp-mongodb:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketException: mongo-1.vamp-mongodb: Name does not resolve}, caused by {java.net.UnknownHostException: mongo-1.vamp-mongodb: Name does not resolve}}]}. Waiting for 30000 ms before timing out
09:24:16.889 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=mongo-0.vamp-mongodb:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 0, 0]}, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, roundTripTimeNanos=994346, setName='rs0', canonicalAddress=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, hosts=[mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017], passives=[], arbiters=[], primary='mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000001, setVersion=2, lastWriteDate=Wed Jul 25 09:24:13 GMT 2018, lastUpdateTimeNanos=5617813473648565}
09:24:16.889 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Discovered cluster type of REPLICA_SET
09:24:16.890 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Adding discovered server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017 to client view of cluster
09:24:16.891 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Server mongo-2.vamp-mongodb:27017 is no longer a member of the replica set.  Removing from client view of cluster.
09:24:16.891 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Server mongo-0.vamp-mongodb:27017 is no longer a member of the replica set.  Removing from client view of cluster.
09:24:16.892 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Server mongo-1.vamp-mongodb:27017 is no longer a member of the replica set.  Removing from client view of cluster.
09:24:16.892 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] INFO  org.mongodb.driver.cluster - Canonical address mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017 does not match server address.  Removing mongo-0.vamp-mongodb:27017 from client view of cluster
09:24:16.892 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=UNKNOWN, state=CONNECTING}]
09:24:16.892 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb:27017] DEBUG org.mongodb.driver.connection - Closing connection connectionId{localValue:2, serverValue:4}
09:24:16.894 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] INFO  org.mongodb.driver.connection - Opened connection [connectionId{localValue:4, serverValue:5}] to mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.894 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.895 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] INFO  org.mongodb.driver.cluster - Monitor thread successfully connected to server with description ServerDescription{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 0, 0]}, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, roundTripTimeNanos=778952, setName='rs0', canonicalAddress=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, hosts=[mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017], passives=[], arbiters=[], primary='mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000001, setVersion=2, lastWriteDate=Wed Jul 25 09:24:13 GMT 2018, lastUpdateTimeNanos=5617813483424191}
09:24:16.895 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] INFO  org.mongodb.driver.cluster - Setting max election id to 7fffffff0000000000000001 from replica set primary mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.895 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] INFO  org.mongodb.driver.cluster - Setting max set version to 2 from replica set primary mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.895 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] INFO  org.mongodb.driver.cluster - Discovered replica set primary mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.896 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.8 ms, state=CONNECTED}]
09:24:16.899 [hz.main.cached.thread-3] INFO  org.mongodb.driver.connection - Opened connection [connectionId{localValue:5, serverValue:6}] to mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.905 [hz.main.cached.thread-3] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='user'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:16.908 [hz.main.cached.thread-3] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.040 [hz.main.partition-operation.thread-15] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'root' }
09:24:17.041 [hz.main.partition-operation.thread-15] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='user'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.043 [hz.main.partition-operation.thread-15] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.072 [hz.main.cached.thread-3] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'role' }
09:24:17.072 [hz.main.cached.thread-3] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='role'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.073 [hz.main.cached.thread-3] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.076 [hz.main.partition-operation.thread-1] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'admin' }
09:24:17.077 [hz.main.partition-operation.thread-1] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='role'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.077 [hz.main.partition-operation.thread-1] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.088 [hz.main.cached.thread-12] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'oAuthClient' }
09:24:17.089 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthClient'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.090 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.092 [hz.main.partition-operation.thread-17] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'frontend' }
09:24:17.092 [hz.main.partition-operation.thread-17] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthClient'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.094 [hz.main.partition-operation.thread-17] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.096 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
09:24:17.096 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.097 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.099 [hz.main.partition-operation.thread-23] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default' }
09:24:17.100 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.100 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.103 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.Main$ - Setting up default project
09:24:17.105 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.DesiredStatesImpl - Put project to  default
09:24:17.107 [hz.main.partition-operation.thread-23] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default' }
09:24:17.108 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.109 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.110 [main-system-akka.actor.default-dispatcher-4] WARN  io.vamp.drivers.NotificationDriver$ - Notification Driver not configured for project=default . using default implementation
09:24:17.113 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.model.DataKeyHelper$ - Cluster Access DataKey map is Map(project -> default) for original project=default
09:24:17.116 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default will create a new one
09:24:17.117 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.DefaultNotificationDriver - Retrieving cluster access for project=default - ClusterAccess(Map()) for notification key project=default
09:24:17.120 [main] WARN  io.vamp.states.DesiredStates$ - Desired States not configured for project=default . using default implementation
09:24:17.120 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
09:24:17.121 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'cluster' }
09:24:17.122 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='cluster'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.122 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.122 [hz.main.cached.thread-9] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'usernotificationregistry' }
09:24:17.123 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.123 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.125 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default,cluster=default' }
09:24:17.126 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='cluster'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.126 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.128 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.Main$ - Setting up default cluster
09:24:17.129 [hz.main.partition-operation.thread-23] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default' }
09:24:17.129 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.DesiredStatesImpl - Put cluster to project=default default
09:24:17.129 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.130 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.132 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.DefaultNotificationDriver - Updating registry with key project=default to UserNotificationRegistry(Set(root))
09:24:17.133 [hz.main.partition-operation.thread-23] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default' }
09:24:17.133 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.134 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.136 [hz.main.partition-operation.thread-23] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default' }
09:24:17.136 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.137 [hz.main.partition-operation.thread-23] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.137 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.Main$ - default project has been created
09:24:17.137 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.DesiredStatesImpl - Cluster access metadata for Cluster: Map()
09:24:17.139 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default,cluster=default' }
09:24:17.140 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='cluster'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.140 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.142 [main-system-akka.actor.default-dispatcher-3] WARN  io.vamp.drivers.NotificationDriver$ - Notification Driver not configured for project=default,cluster=default . using default implementation
09:24:17.142 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.model.DataKeyHelper$ - Cluster Access DataKey map is Map(project -> default, cluster -> default) for original project=default,cluster=default
09:24:17.142 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.DefaultNotificationDriver - Retrieving cluster access for project=default,cluster=default - ClusterAccess(Map()) for notification key project=default,cluster=default
09:24:17.143 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default,cluster=default' }
09:24:17.144 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.144 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.144 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.DefaultNotificationDriver - Updating registry with key project=default,cluster=default to UserNotificationRegistry(Set(root))
09:24:17.145 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default,cluster=default' }
09:24:17.145 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.145 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.146 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'project=default,cluster=default' }
09:24:17.146 [hz.main.cached.thread-9] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'job' }
09:24:17.146 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='usernotificationregistry'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.146 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.146 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.Main$ - default cluster has been created
09:24:17.147 [hz.main.cached.thread-9] INFO  org.mongodb.driver.connection - Opened connection [connectionId{localValue:6, serverValue:7}] to mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.148 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='job'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.148 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.150 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : '' }
09:24:17.150 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='job'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.152 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.167 [hz.main.cached.thread-9] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
09:24:17.170 [hz.main.partition-operation.thread-11] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : '' }
09:24:17.170 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='job'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.171 [hz.main.partition-operation.thread-11] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.171 [scala-execution-context-global-134] INFO  i.vamp.states.impl.DesiredStatesImpl - Scheduled job  with task name is ec142ee0-a45e-4e85-805e-b1cbadd50d84
09:24:17.175 [hz.main.cached.thread-9] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 9:24:17 AM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
09:24:17.177 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
09:24:17.177 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:17.178 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:17.224 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
09:24:17.228 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
09:24:17.229 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
09:24:17.231 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
09:24:17.231 [scala-execution-context-global-203] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
09:24:17.232 [main-system-akka.actor.default-dispatcher-3] WARN  io.vamp.states.CurrentStates$ - Current States not configured for  . using default implementation
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='service', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='deployment', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='project', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='cluster', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='virtualCluster', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='application', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='gateway', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='virtualService', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='experiment', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='destinationRule', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='ingress', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
Jul 25, 2018 9:24:17 AM com.hazelcast.cache.impl.CacheService
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Added cache config: CacheConfig{name='serviceEntry', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null}
09:24:17.263 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
09:24:17.264 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
09:24:17.264 [scala-execution-context-global-203] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
09:24:17.264 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
09:24:17.266 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
09:24:17.267 [scala-execution-context-global-203] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
09:24:17.268 [main-system-akka.actor.default-dispatcher-3] WARN  io.vamp.states.CurrentStates$ - Current States not configured for project=default . using default implementation
09:24:17.280 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
09:24:17.281 [main-system-akka.actor.default-dispatcher-3] WARN  io.vamp.drivers.ContainerDriver$ - Container Driver not configured for project=default,cluster=default . using default implementation
09:24:17.289 [scala-execution-context-global-203] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
09:24:17.289 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from Kubernetes config...
09:24:17.289 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Did not find Kubernetes config at: [/home/app/.kube/config]. Ignoring.
09:24:17.289 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from service account...
09:24:17.289 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Found service account host and port: 192.168.254.1:443
09:24:17.290 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt].
09:24:17.290 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token].
09:24:17.290 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client namespace from Kubernetes service account namespace path...
09:24:17.290 [scala-execution-context-global-203] DEBUG io.fabric8.kubernetes.client.Config - Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace].
09:24:17.293 [scala-execution-context-global-203] INFO  i.v.d.i.k.KubernetesContainerDriver - Kubernetes Client is configured as Map()
09:24:17.297 [scala-execution-context-global-203] DEBUG i.v.d.i.k.KubernetesContainerDriver - Registering to events for namespace vamp-system
09:24:17.306 [scala-execution-context-global-203] DEBUG i.f.k.c.d.i.WatchConnectionManager - Connecting websocket ... io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager@3d62df29
09:24:17.361 [OkHttp https://192.168.254.1/...] DEBUG i.f.k.c.d.i.WatchConnectionManager - WebSocket successfully opened
09:24:17.399 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Successfully assigned mongo-0 to test.abc.io
09:24:17.400 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Successfully assigned mongo-0 to test.abc.io
09:24:17.400 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.405 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => MountVolume.SetUp succeeded for volume "mongo-persistent-storage" 
09:24:17.406 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => MountVolume.SetUp succeeded for volume "mongo-persistent-storage" 
09:24:17.406 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.407 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => MountVolume.SetUp succeeded for volume "default-token-jm7nm" 
09:24:17.407 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => MountVolume.SetUp succeeded for volume "default-token-jm7nm" 
09:24:17.407 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.409 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => pulling image "mongo"
09:24:17.409 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => pulling image "mongo"
09:24:17.409 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.411 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Successfully pulled image "mongo"
09:24:17.411 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Successfully pulled image "mongo"
09:24:17.411 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.413 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Created container
09:24:17.413 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Created container
09:24:17.413 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.414 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Started container
09:24:17.414 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Started container
09:24:17.414 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.415 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => pulling image "cvallance/mongo-k8s-sidecar"
09:24:17.415 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => pulling image "cvallance/mongo-k8s-sidecar"
09:24:17.415 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.416 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Successfully pulled image "cvallance/mongo-k8s-sidecar"
09:24:17.416 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Successfully pulled image "cvallance/mongo-k8s-sidecar"
09:24:17.416 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.416 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Created container
09:24:17.416 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Created container
09:24:17.416 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.417 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name mongo-0 => Started container
09:24:17.417 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo-0 => Started container
09:24:17.417 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.418 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - StatefulSet with name mongo => create Pod mongo-0 in StatefulSet mongo successful
09:24:17.418 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event mongo => create Pod mongo-0 in StatefulSet mongo successful
09:24:17.418 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.418 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name vamp-7f4695d68f-px2t5 => Successfully assigned vamp-7f4695d68f-px2t5 to test.abc.io
09:24:17.418 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp-7f4695d68f-px2t5 => Successfully assigned vamp-7f4695d68f-px2t5 to test.abc.io
09:24:17.418 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.419 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name vamp-7f4695d68f-px2t5 => MountVolume.SetUp succeeded for volume "default-token-jm7nm" 
09:24:17.419 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp-7f4695d68f-px2t5 => MountVolume.SetUp succeeded for volume "default-token-jm7nm" 
09:24:17.419 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.419 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name vamp-7f4695d68f-px2t5 => Container image "magneticio/vamp2:0.3.0" already present on machine
09:24:17.419 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp-7f4695d68f-px2t5 => Container image "magneticio/vamp2:0.3.0" already present on machine
09:24:17.420 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.423 [scala-execution-context-global-203] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set()
09:24:17.425 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name vamp-7f4695d68f-px2t5 => Created container
09:24:17.425 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp-7f4695d68f-px2t5 => Created container
09:24:17.425 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.425 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name vamp-7f4695d68f-px2t5 => Started container
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp-7f4695d68f-px2t5 => Started container
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.426 [main-system-akka.actor.default-dispatcher-3] WARN  io.vamp.drivers.NetworkDriver$ - RouteRule Driver not configured for project=default,cluster=default . using default implementation
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - ReplicaSet with name vamp-7f4695d68f => Created pod: vamp-7f4695d68f-px2t5
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp-7f4695d68f => Created pod: vamp-7f4695d68f-px2t5
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Deployment with name vamp => Scaled up replica set vamp-7f4695d68f to 1
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event vamp => Scaled up replica set vamp-7f4695d68f to 1
09:24:17.426 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.439 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
09:24:17.439 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from Kubernetes config...
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Did not find Kubernetes config at: [/home/app/.kube/config]. Ignoring.
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from service account...
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account host and port: 192.168.254.1:443
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt].
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token].
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client namespace from Kubernetes service account namespace path...
09:24:17.440 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace].
09:24:17.441 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Kubernetes Client is configured as Map()
09:24:17.445 [main-system-akka.actor.default-dispatcher-3] DEBUG i.v.d.impl.istio.IstioNetworkDriver - Registering to events for namespace vamp-system
09:24:17.449 [main-system-akka.actor.default-dispatcher-3] DEBUG i.f.k.c.d.i.WatchConnectionManager - Connecting websocket ... io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager@c455f88
09:24:17.500 [OkHttp https://192.168.254.1/...] DEBUG i.f.k.c.d.i.WatchConnectionManager - WebSocket successfully opened
09:24:17.757 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:24:17.758 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:24:17.785 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required services :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, prometheus, prometheus-external, servicegraph, tracing, zipkin, elasticsearch, fluentd-es, kibana, elasticsearch-external)
09:24:17.785 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual services :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, prometheus, servicegraph, tracing, zipkin, elasticsearch, fluentd-es, kibana)
09:24:17.786 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
09:24:17.812 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
09:24:17.812 [main-system-akka.actor.default-dispatcher-3] WARN  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster
09:24:17.813 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from Kubernetes config...
09:24:17.813 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Did not find Kubernetes config at: [/home/app/.kube/config]. Ignoring.
09:24:17.813 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client from service account...
09:24:17.813 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account host and port: 192.168.254.1:443
09:24:17.813 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt].
09:24:17.814 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token].
09:24:17.814 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Trying to configure client namespace from Kubernetes service account namespace path...
09:24:17.814 [main-system-akka.actor.default-dispatcher-3] DEBUG io.fabric8.kubernetes.client.Config - Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace].
09:24:17.815 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Kubernetes Client is configured as Map()
09:24:17.994 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Job with name istio-initializer => Created pod: istio-initializer-v2gch
09:24:17.994 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event istio-initializer => Created pod: istio-initializer-v2gch
09:24:17.994 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.995 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name istio-initializer-v2gch => Successfully assigned istio-initializer-v2gch to test.abc.io
09:24:17.995 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event istio-initializer-v2gch => Successfully assigned istio-initializer-v2gch to test.abc.io
09:24:17.995 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:17.996 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Gateway system initialization started
09:24:17.996 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initialization started for cluster default
09:24:17.997 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initialization started for cluster default,true)))
09:24:17.999 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initialization started for cluster default
09:24:18.000 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
09:24:18.012 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initialization started for cluster default - Topic: root-notifications
09:24:18.249 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name istio-initializer-v2gch => MountVolume.SetUp succeeded for volume "default-token-jm7nm" 
09:24:18.249 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event istio-initializer-v2gch => MountVolume.SetUp succeeded for volume "default-token-jm7nm" 
09:24:18.249 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:18.701 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name istio-initializer-v2gch => Container image "magneticio/vamp2:istioinitializer_0.0.95" already present on machine
09:24:18.702 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event istio-initializer-v2gch => Container image "magneticio/vamp2:istioinitializer_0.0.95" already present on machine
09:24:18.702 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:18.709 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name istio-initializer-v2gch => Created container
09:24:18.709 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event istio-initializer-v2gch => Created container
09:24:18.709 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:18.953 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Pod with name istio-initializer-v2gch => Started container
09:24:18.953 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Handling event istio-initializer-v2gch => Started container
09:24:18.953 [OkHttp https://192.168.254.1/...] DEBUG i.v.d.i.k.KubernetesContainerDriver - Sync deployment's current state
09:24:21.654 [hz.main.cached.thread-9] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'root', 'size of value' : 'User(root,admin,admin,Set())' }
09:24:21.660 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='user'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:21.664 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:22.075 [hz.main.cached.thread-9] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'admin', 'size of value' : 'Role(admin,Map(serviceEntry -> Permission(true,true,true,true), application -> Permission(true,true,true,true), deployment -> Permission(true,true,true,true), role -> Permission(true,true,true,true), project -> Permission(true,true,true,true), ingress -> Permission(true,true,true,true), service -> Permission(true,true,true,true), gateway -> Permission(true,true,true,true), cluster -> Permission(true,true,true,true), virtualService -> Permission(true,true,true,true), destinationRule -> Permission(true,true,true,true), user -> Permission(true,true,true,true), virtualCluster -> Permission(true,true,true,true), experiment -> Permission(true,true,true,true)))' }
09:24:22.076 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='role'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:22.081 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:22.091 [hz.main.cached.thread-9] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'frontend', 'size of value' : 'OAuthClient(root,password,frontend,,None,1532510657082)' }
09:24:22.091 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='oAuthClient'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:22.095 [hz.main.cached.thread-9] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:22.099 [hz.main.cached.thread-8] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'project=default', 'size of value' : 'ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)' }
09:24:22.099 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:22.103 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:22.124 [hz.main.cached.thread-8] INFO  i.v.p.impl.PersistenceMapStore - StoreAll { 'mapName' : 'usernotificationregistry' }
09:24:22.124 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'project=default,cluster=default', 'size of value' : 'ClusterSpecification(project=default,default,1532510657129,Map(),Set(),Set(),false)' }
09:24:22.125 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='cluster'}} to database vamp on connection [connectionId{localValue:6, serverValue:7}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:22.129 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:22.136 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.update - Updating documents in namespace vamp.usernotificationregistry on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:22.143 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.update - Update completed
09:24:22.147 [hz.main.cached.thread-8] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : '', 'size of value' : 'ec142ee0-a45e-4e85-805e-b1cbadd50d84' }
09:24:22.147 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='job'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:22.151 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:26.896 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:26.897 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.8 ms, state=CONNECTED}]
09:24:36.897 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:36.899 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.8 ms, state=CONNECTED}]
09:24:46.899 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:46.900 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.8 ms, state=CONNECTED}]
09:24:47.166 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
09:24:47.167 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 9:24:47 AM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
09:24:47.167 [hz.main.cached.thread-8] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
09:24:47.168 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:47.169 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:24:47.180 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
09:24:47.181 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
09:24:47.181 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
09:24:47.181 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
09:24:47.181 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
09:24:47.183 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
09:24:47.183 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
09:24:47.183 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
09:24:47.184 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
09:24:47.184 [hz.main.cached.thread-8] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
09:24:47.184 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
09:24:47.185 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
09:24:47.185 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
09:24:47.189 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set()
09:24:47.189 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
09:24:47.212 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:24:47.212 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:24:47.213 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
09:24:47.214 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
09:24:47.214 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
09:24:47.214 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
09:24:47.215 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
09:24:47.215 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
09:24:47.215 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
09:24:47.217 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
09:24:56.900 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:24:56.901 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.8 ms, state=CONNECTED}]
09:25:06.901 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:06.902 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
09:25:16.903 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:16.904 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
09:25:17.166 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
09:25:17.167 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 9:25:17 AM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
09:25:17.167 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
09:25:17.168 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:17.169 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:25:17.180 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
09:25:17.180 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
09:25:17.180 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
09:25:17.180 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
09:25:17.181 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
09:25:17.182 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
09:25:17.182 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
09:25:17.182 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
09:25:17.183 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
09:25:17.183 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
09:25:17.183 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
09:25:17.184 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
09:25:17.185 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
09:25:17.188 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set()
09:25:17.188 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
09:25:17.201 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:25:17.201 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:25:17.202 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
09:25:17.203 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
09:25:17.203 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
09:25:17.203 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
09:25:17.203 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
09:25:17.203 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
09:25:17.203 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
09:25:17.205 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
09:25:26.904 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:26.905 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
09:25:36.905 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:36.906 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
09:25:46.906 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:46.907 [cluster-ClusterId{value='5b5841c048bb9d0001e0c244', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
09:25:47.166 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
09:25:47.167 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 9:25:47 AM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.198]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
09:25:47.167 [hz.main.cached.thread-6] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
09:25:47.168 [hz.main.cached.thread-6] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:5, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
09:25:47.168 [hz.main.cached.thread-6] DEBUG org.mongodb.driver.protocol.command - Command execution completed
09:25:47.179 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
09:25:47.180 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
09:25:47.180 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
09:25:47.180 [hz.main.cached.thread-6] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
09:25:47.181 [hz.main.cached.thread-6] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
09:25:47.182 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
09:25:47.182 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
09:25:47.182 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
09:25:47.182 [hz.main.cached.thread-6] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
09:25:47.182 [hz.main.cached.thread-6] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
09:25:47.183 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
09:25:47.183 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
09:25:47.184 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
09:25:47.186 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set()
09:25:47.186 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
09:25:47.198 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:25:47.198 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
09:25:47.199 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
09:25:47.199 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
09:25:47.199 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
09:25:47.199 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
09:25:47.199 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
09:25:47.200 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
09:25:47.200 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
09:25:47.201 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications

+ kubectl config set-cluster cfc --server=https://kubernetes.default --certificate-authority=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt
Cluster "cfc" set.
+ kubectl config set-context cfc --cluster=cfc
Context "cfc" created.
++ cat /var/run/secrets/kubernetes.io/serviceaccount/token
+ TOKEN=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJ2YW1wLXN5c3RlbSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJkZWZhdWx0LXRva2VuLWptN25tIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQubmFtZSI6ImRlZmF1bHQiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiI3YTI3YWEzZS04ZmVjLTExZTgtOWU5Zi02YzkyYmY2M2U4MGQiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6dmFtcC1zeXN0ZW06ZGVmYXVsdCJ9.WHdbBemmxASSb8Ow2SGWuJCRdte6xznyJKRH-W3fmWWtxNHfzlk1omSBwHJhBKRR0S0DNc8Q8ajHy49QrJtql_sdINNYPd49w0AbENZjmutaxoq1bgHYxZXaUBZ4ianzTpbBv3WzbJpNtYR2bfgYQ9MycthsCfP9iBlczQRhb2-WYV1fwiH-YIk2TaXImzAPLFhWrEAfv8Gby88254leRvAtQxLKIwc-veFItdRYgImof_vajWQwkAdYmrSTN8WCdFe_3vPOwNypMttIwCsMsdgsffoSqazBHfjVdEvbibOnzRQTM0o68Iq-u2YhQ3HDQLQu0e0J6DJX4F2PmRP3Sg
+ USER_ID=default
+ kubectl config set-credentials default --token=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJ2YW1wLXN5c3RlbSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJkZWZhdWx0LXRva2VuLWptN25tIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQubmFtZSI6ImRlZmF1bHQiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC51aWQiOiI3YTI3YWEzZS04ZmVjLTExZTgtOWU5Zi02YzkyYmY2M2U4MGQiLCJzdWIiOiJzeXN0ZW06c2VydmljZWFjY291bnQ6dmFtcC1zeXN0ZW06ZGVmYXVsdCJ9.WHdbBemmxASSb8Ow2SGWuJCRdte6xznyJKRH-W3fmWWtxNHfzlk1omSBwHJhBKRR0S0DNc8Q8ajHy49QrJtql_sdINNYPd49w0AbENZjmutaxoq1bgHYxZXaUBZ4ianzTpbBv3WzbJpNtYR2bfgYQ9MycthsCfP9iBlczQRhb2-WYV1fwiH-YIk2TaXImzAPLFhWrEAfv8Gby88254leRvAtQxLKIwc-veFItdRYgImof_vajWQwkAdYmrSTN8WCdFe_3vPOwNypMttIwCsMsdgsffoSqazBHfjVdEvbibOnzRQTM0o68Iq-u2YhQ3HDQLQu0e0J6DJX4F2PmRP3Sg
User "default" set.
+ kubectl config set-context cfc --user=default
Context "cfc" modified.
+ kubectl config use-context cfc
Switched to context "cfc".
+ cd istio-0.8.0
+ export PATH=/istio-0.8.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ PATH=/istio-0.8.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ kubectl apply -f install/kubernetes/elasticsearch.yaml
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
namespace "logging" configured
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
service "elasticsearch" configured
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
deployment "elasticsearch" configured
+ curl 'http://elasticsearch:9200/_cat/health?v'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (6) Could not resolve host: elasticsearch
+ [[ 6 -ne 0 ]]
+ [[ '' < 5 ]]
+ echo 'Waiting for elasticsearch'
+ ((  RETRIES += 1  ))
Waiting for elasticsearch
+ sleep 5
+ curl 'http://elasticsearch:9200/_cat/health?v'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (6) Could not resolve host: elasticsearch
+ [[ 6 -ne 0 ]]
+ [[ 1 < 5 ]]
+ echo 'Waiting for elasticsearch'
+ ((  RETRIES += 1  ))
+ sleep 5
Waiting for elasticsearch
+ curl 'http://elasticsearch:9200/_cat/health?v'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (6) Could not resolve host: elasticsearch
+ [[ 6 -ne 0 ]]
+ [[ 2 < 5 ]]
+ echo 'Waiting for elasticsearch'
+ ((  RETRIES += 1  ))
+ sleep 5
Waiting for elasticsearch
+ curl 'http://elasticsearch:9200/_cat/health?v'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (6) Could not resolve host: elasticsearch
+ [[ 6 -ne 0 ]]
+ [[ 3 < 5 ]]
+ echo 'Waiting for elasticsearch'
Waiting for elasticsearch
+ ((  RETRIES += 1  ))
+ sleep 5
+ curl 'http://elasticsearch:9200/_cat/health?v'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (6) Could not resolve host: elasticsearch
+ [[ 6 -ne 0 ]]
+ [[ 4 < 5 ]]
+ echo 'Waiting for elasticsearch'
Waiting for elasticsearch
+ ((  RETRIES += 1  ))
+ sleep 5
+ curl 'http://elasticsearch:9200/_cat/health?v'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0curl: (6) Could not resolve host: elasticsearch
+ [[ 6 -ne 0 ]]
+ [[ 5 < 5 ]]
+ kubectl apply -f install/kubernetes/logging-stack.yaml
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
service "fluentd-es" configured
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
deployment "fluentd-es" configured
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
configmap "fluentd-es-config" configured
configmap "mapping-config" created
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
service "kibana" configured
Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
deployment "kibana" configured
+ kubectl rollout status deploy fluentd-es -n logging
Waiting for rollout to finish: 0 of 1 updated replicas are available...
avalcepina commented 6 years ago

@wansuiye did you try this on a clean cluster or was istio already installed (or partially installed) ? If you had already an older version, that may cause issues. Also what user are you logging in as? We didn't thoroughly test non-root users for the time being, so you might get some problems there as well, especially regarding notifications. I see some notifications in the logs so you should be getting those at the very least.

Finally, can you provide more logs after you stop getting this one:

09:25:47.199 [main-system-akka.actor.default-dispatcher-2] INFO i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default

You should check what the IstioSetupClusterPolicyExecutor is logging, that is where new namespaces are detected. the log you should be seeing is something like:

Cluster is ready, will check virtual clusters

wansuiye commented 6 years ago

@avalcepina thanks for the reply. i tried this while the istio was already installed（partially）, the version is 0.8.0. i login with root user. image

the left log is below, with find IstioSetupClusterPolicyExecutor:

12:13:29.492 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:13:39.202 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:13:39.203 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:13:49.204 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:13:49.205 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:13:59.205 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:13:59.206 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:13:59.456 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:13:59.457 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:13:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:13:59.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:13:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:13:59.459 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:13:59.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:13:59.470 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:13:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:13:59.470 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:13:59.471 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:13:59.472 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:13:59.472 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:13:59.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:13:59.472 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:13:59.473 [hz.main.cached.thread-8] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:13:59.473 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:13:59.474 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:13:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:13:59.477 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:13:59.477 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:13:59.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:13:59.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:13:59.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:13:59.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:13:59.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:13:59.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:13:59.489 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:13:59.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:13:59.489 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:13:59.490 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:13:59.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:14:09.206 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:09.207 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:14:19.207 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:19.208 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:14:29.209 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:29.210 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:14:29.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:14:29.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:14:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:14:29.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:14:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:29.459 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:14:29.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:14:29.470 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:14:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:14:29.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:14:29.470 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:14:29.472 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:14:29.472 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:14:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:14:29.472 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:14:29.473 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:14:29.473 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:14:29.474 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:14:29.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:14:29.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:14:29.477 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:14:29.487 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:14:29.487 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:14:29.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:14:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:14:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:14:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:14:29.489 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:14:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:14:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:14:29.490 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:14:29.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:14:39.210 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:39.211 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:14:49.211 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:49.212 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:14:59.212 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:59.213 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:14:59.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:14:59.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:14:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:14:59.458 [hz.main.cached.thread-8] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:14:59.458 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:14:59.459 [hz.main.cached.thread-8] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:14:59.470 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:14:59.470 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:14:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:14:59.470 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:14:59.471 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:14:59.472 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:14:59.472 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:14:59.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:14:59.472 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:14:59.473 [hz.main.cached.thread-8] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:14:59.473 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:14:59.473 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:14:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:14:59.478 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:14:59.478 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:14:59.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:14:59.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:14:59.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:14:59.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:14:59.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:14:59.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:14:59.489 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:14:59.490 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:14:59.490 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:14:59.490 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:14:59.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:15:09.213 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:09.214 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:15:19.214 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:19.215 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:15:29.216 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:29.217 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:15:29.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:15:29.457 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:15:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:15:29.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:15:29.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:29.459 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:15:29.469 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:15:29.470 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:15:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:15:29.470 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:15:29.470 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:15:29.471 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:15:29.471 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:15:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:15:29.472 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:15:29.472 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:15:29.472 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:15:29.473 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:15:29.473 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:15:29.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:15:29.476 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:15:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:15:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:15:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:15:29.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:15:29.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:15:29.489 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:15:29.489 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:15:29.490 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:15:29.490 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:15:29.490 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:15:29.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:15:39.217 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:39.218 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:15:49.218 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:49.219 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:15:59.219 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:59.220 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:15:59.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:15:59.457 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:15:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:15:59.458 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:15:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:15:59.459 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:15:59.470 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:15:59.470 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:15:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:15:59.470 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:15:59.470 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:15:59.472 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:15:59.472 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:15:59.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:15:59.472 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:15:59.472 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:15:59.472 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:15:59.473 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:15:59.473 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:15:59.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:15:59.476 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:15:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:15:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:15:59.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:15:59.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:15:59.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:15:59.487 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:15:59.487 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:15:59.487 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:15:59.487 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:15:59.487 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:15:59.488 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:16:09.220 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:09.221 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:16:19.222 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:19.223 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:16:29.223 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:29.224 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:16:29.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:16:29.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
12:16:29.458 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
Jul 25, 2018 12:16:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:16:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:29.459 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:16:29.470 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:16:29.470 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:16:29.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:16:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:16:29.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:16:29.472 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:16:29.472 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:16:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:16:29.472 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:16:29.472 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:16:29.472 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:16:29.473 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:16:29.473 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:16:29.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:16:29.476 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:16:29.486 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:16:29.486 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:16:29.486 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:16:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:16:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:16:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:16:29.487 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:16:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:16:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:16:29.487 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:16:29.489 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:16:39.224 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:39.225 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:16:49.225 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:49.226 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:16:59.226 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:59.227 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:16:59.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:16:59.457 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:16:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:16:59.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:16:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:16:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:16:59.469 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:16:59.469 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:16:59.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:16:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:16:59.470 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:16:59.471 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:16:59.471 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:16:59.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:16:59.471 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:16:59.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:16:59.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:16:59.472 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:16:59.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:16:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:16:59.475 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:16:59.484 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:16:59.484 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:16:59.484 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:16:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:16:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:16:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:16:59.485 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:16:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:16:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:16:59.485 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:16:59.487 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:17:09.227 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:09.228 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:17:19.228 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:19.229 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:17:29.230 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:29.231 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:17:29.456 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:17:29.457 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:17:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:17:29.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:17:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:17:29.469 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:17:29.469 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:17:29.469 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:17:29.469 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:17:29.470 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:17:29.470 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:17:29.470 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:17:29.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:17:29.471 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:17:29.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:17:29.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:17:29.472 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:17:29.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:17:29.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:17:29.474 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:17:29.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:17:29.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:17:29.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:17:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:17:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:17:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:17:29.484 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:17:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:17:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:17:29.484 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:17:29.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:17:39.231 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:39.232 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:17:49.232 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:49.233 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:17:59.233 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:59.234 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:17:59.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:17:59.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:17:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:17:59.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:17:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:17:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:17:59.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:17:59.469 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:17:59.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:17:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:17:59.470 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:17:59.471 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:17:59.471 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:17:59.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:17:59.471 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:17:59.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:17:59.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:17:59.472 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:17:59.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:17:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:17:59.474 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:17:59.483 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:17:59.483 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:17:59.483 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:17:59.483 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:17:59.483 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:17:59.483 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:17:59.483 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:17:59.484 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:17:59.484 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:17:59.484 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:17:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:18:09.234 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:09.235 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:18:19.235 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:19.236 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:18:29.236 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:29.237 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:18:29.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:18:29.457 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:18:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:18:29.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:18:29.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:29.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:18:29.469 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:18:29.470 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:18:29.470 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:18:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:18:29.470 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:18:29.471 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:18:29.471 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:18:29.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:18:29.471 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:18:29.471 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:18:29.472 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:18:29.472 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:18:29.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:18:29.475 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:18:29.475 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:18:29.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:18:29.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:18:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:18:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:18:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:18:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:18:29.484 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:18:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:18:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:18:29.484 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:18:29.486 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:18:39.237 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:39.238 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:18:49.239 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:49.240 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:18:59.240 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:59.241 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:18:59.456 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:18:59.457 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:18:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:18:59.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:18:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:18:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:18:59.469 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:18:59.469 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:18:59.470 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:18:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:18:59.470 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:18:59.471 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:18:59.471 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:18:59.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:18:59.471 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:18:59.471 [hz.main.cached.thread-8] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:18:59.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:18:59.472 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:18:59.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:18:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:18:59.474 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:18:59.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:18:59.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:18:59.483 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:18:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:18:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:18:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:18:59.484 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:18:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:18:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:18:59.484 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:18:59.485 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:19:09.241 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:09.242 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:19:19.242 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:19.243 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:19:29.243 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:29.244 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:19:29.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:19:29.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:19:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:19:29.458 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:19:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:29.459 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:19:29.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:19:29.470 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:19:29.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:19:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:19:29.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:19:29.472 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:19:29.472 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:19:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:19:29.472 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:19:29.472 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:19:29.472 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:19:29.473 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:19:29.473 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:19:29.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:19:29.477 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:19:29.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:19:29.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:19:29.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:19:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:19:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:19:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:19:29.489 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:19:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:19:29.489 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:19:29.489 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:19:29.490 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:19:39.244 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:39.245 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:19:49.245 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:49.246 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:19:59.246 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:59.247 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:19:59.456 [hz.main.cached.thread-8] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:19:59.457 [hz.main.cached.thread-8] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:19:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:19:59.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:19:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:19:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:19:59.469 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:19:59.470 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:19:59.470 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:19:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:19:59.470 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:19:59.471 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:19:59.471 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:19:59.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:19:59.471 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:19:59.471 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:19:59.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:19:59.472 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:19:59.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:19:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:19:59.475 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:19:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:19:59.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:19:59.485 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:19:59.485 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:19:59.485 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:19:59.485 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:19:59.486 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:19:59.486 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:19:59.486 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:19:59.486 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:19:59.487 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:20:09.247 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:09.249 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:20:19.249 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:19.250 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:20:29.250 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:29.251 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:20:29.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:20:29.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:20:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:20:29.458 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:20:29.459 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:29.459 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:20:29.471 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:20:29.472 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:20:29.472 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:20:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:20:29.472 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:20:29.473 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:20:29.473 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:20:29.473 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:20:29.473 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:20:29.473 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:20:29.473 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:20:29.474 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:20:29.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:20:29.477 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:20:29.477 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:20:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:20:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:20:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:20:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:20:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:20:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:20:29.488 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:20:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:20:29.488 [main-system-akka.actor.default-dispatcher-3] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:20:29.488 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:20:29.490 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:20:39.252 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:39.252 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:20:49.253 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:49.254 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:20:59.254 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:59.255 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:20:59.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:20:59.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:20:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:20:59.457 [hz.main.cached.thread-5] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:20:59.458 [hz.main.cached.thread-5] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:20:59.458 [hz.main.cached.thread-5] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:20:59.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:20:59.469 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:20:59.470 [hz.main.cached.thread-5] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:20:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:20:59.470 [hz.main.cached.thread-5] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:20:59.471 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:20:59.471 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:20:59.471 [hz.main.cached.thread-5] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:20:59.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:20:59.472 [hz.main.cached.thread-5] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:20:59.472 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:20:59.473 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:20:59.473 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:20:59.475 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:20:59.475 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:20:59.484 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:20:59.484 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:20:59.484 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:20:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:20:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:20:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:20:59.485 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:20:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:20:59.485 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:20:59.485 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:20:59.486 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:21:09.255 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:09.256 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:21:19.256 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:19.257 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:21:29.257 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:29.258 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:21:29.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:21:29.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:21:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:21:29.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:21:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:29.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:21:29.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:21:29.470 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:21:29.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:21:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:21:29.470 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:21:29.472 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:21:29.472 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:21:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:21:29.472 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:21:29.472 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:21:29.473 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:21:29.473 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:21:29.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:21:29.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:21:29.476 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:21:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:21:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:21:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:21:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:21:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:21:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:21:29.485 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:21:29.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:21:29.486 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:21:29.486 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:21:29.487 [main-system-akka.actor.default-dispatcher-3] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:21:39.258 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:39.259 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:21:49.259 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:49.260 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:21:59.260 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:59.262 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:21:59.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:21:59.457 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:21:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:21:59.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:21:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:21:59.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:21:59.474 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:21:59.474 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:21:59.474 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:21:59.474 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:21:59.474 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:21:59.476 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:21:59.476 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:21:59.476 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:21:59.476 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:21:59.476 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:21:59.476 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:21:59.477 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:21:59.477 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:21:59.481 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:21:59.481 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:21:59.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:21:59.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:21:59.491 [main-system-akka.actor.default-dispatcher-2] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:21:59.492 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:21:59.492 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:21:59.492 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:21:59.492 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:21:59.492 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:21:59.492 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:21:59.492 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:21:59.494 [main-system-akka.actor.default-dispatcher-26] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:22:09.262 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:09.263 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:22:19.263 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:19.265 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.7 ms, state=CONNECTED}]
12:22:29.265 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:29.266 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:22:29.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:22:29.458 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:22:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:22:29.459 [hz.main.cached.thread-5] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:22:29.459 [hz.main.cached.thread-5] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:29.460 [hz.main.cached.thread-5] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:22:29.471 [main-system-akka.actor.default-dispatcher-24] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:22:29.471 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:22:29.471 [hz.main.cached.thread-5] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:22:29.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:22:29.472 [hz.main.cached.thread-5] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:22:29.472 [main-system-akka.actor.default-dispatcher-24] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:22:29.472 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:22:29.472 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:22:29.473 [hz.main.cached.thread-5] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:22:29.473 [hz.main.cached.thread-5] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:22:29.473 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:22:29.474 [main-system-akka.actor.default-dispatcher-24] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:22:29.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:22:29.476 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:22:29.476 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:22:29.485 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:22:29.485 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:22:29.485 [main-system-akka.actor.default-dispatcher-24] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:22:29.485 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:22:29.485 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:22:29.485 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:22:29.485 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:22:29.486 [main-system-akka.actor.default-dispatcher-24] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:22:29.486 [main-system-akka.actor.default-dispatcher-24] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:22:29.486 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:22:29.488 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:22:39.266 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:39.267 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:22:49.267 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:49.268 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:22:59.268 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:59.269 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:22:59.456 [hz.main.cached.thread-5] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:22:59.457 [hz.main.cached.thread-5] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:22:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:22:59.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:22:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:22:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:22:59.469 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:22:59.470 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:22:59.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:22:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:22:59.470 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:22:59.471 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:22:59.471 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:22:59.471 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:22:59.471 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:22:59.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:22:59.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:22:59.472 [main-system-akka.actor.default-dispatcher-30] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:22:59.472 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:22:59.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:22:59.474 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:22:59.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:22:59.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:22:59.484 [main-system-akka.actor.default-dispatcher-30] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:22:59.484 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:22:59.484 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:22:59.484 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:22:59.484 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:22:59.484 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:22:59.484 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:22:59.484 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:22:59.486 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:23:09.269 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:09.270 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:23:19.270 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:19.271 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:23:29.271 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:29.272 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:23:29.456 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:23:29.457 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:23:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:23:29.457 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:23:29.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:29.458 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:23:29.469 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:23:29.469 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:23:29.469 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:23:29.469 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:23:29.470 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:23:29.470 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:23:29.470 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:23:29.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:23:29.470 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:23:29.471 [hz.main.cached.thread-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:23:29.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:23:29.471 [main-system-akka.actor.default-dispatcher-30] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:23:29.471 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:23:29.474 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:23:29.474 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:23:29.482 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:23:29.482 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:23:29.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:23:29.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:23:29.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:23:29.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:23:29.483 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:23:29.483 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:23:29.483 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:23:29.483 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:23:29.484 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
12:23:39.272 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:39.273 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.5 ms, state=CONNECTED}]
12:23:49.273 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:49.275 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:23:59.275 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:59.276 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:23:59.456 [hz.main.cached.thread-4] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:23:59.457 [hz.main.cached.thread-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:23:59 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:23:59.457 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:23:59.457 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:23:59.458 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:23:59.469 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:23:59.469 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:23:59.469 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:23:59.469 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:23:59.469 [hz.main.cached.thread-7] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:23:59.470 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:23:59.470 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:23:59.470 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:23:59.470 [hz.main.cached.thread-7] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:23:59.471 [hz.main.cached.thread-7] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:23:59.471 [scala-execution-context-global-134] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:23:59.471 [main-system-akka.actor.default-dispatcher-30] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:23:59.471 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:23:59.475 [scala-execution-context-global-134] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:23:59.476 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:23:59.486 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:23:59.487 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:23:59.487 [main-system-akka.actor.default-dispatcher-30] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:23:59.487 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:23:59.487 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:23:59.487 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:23:59.487 [scala-execution-context-global-134] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:23:59.488 [main-system-akka.actor.default-dispatcher-30] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:23:59.488 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:23:59.488 [scala-execution-context-global-134] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:23:59.489 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
[WARN] [07/25/2018 12:24:04.948] [main-system-akka.actor.default-dispatcher-2] [akka.actor.ActorSystemImpl(main-system)] Illegal header: Illegal 'accept' header: Invalid input '.', expected '/', OWS, 'EOI', listSep or ws (line 1, column 60): application/json, application/xml, text/plain, text/html, *.*
                                                           ^
12:24:05.020 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.oauth.OAuth2DataHanlder - Validating client frontend
12:24:05.022 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieving user root
12:24:05.024 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieving access token root, frontend
12:24:05.026 [main-system-akka.actor.default-dispatcher-2] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with key : ''
12:24:05.028 [main-system-akka.actor.default-dispatcher-2] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Found no token from store 'IMap{name='oAuthAccessToken'}' with key : ''
12:24:05.033 [main-system-akka.actor.default-dispatcher-2] INFO  io.vamp.oauth.OAuth2DataHanlder - Creating access token root, frontend
12:24:05.033 [main-system-akka.actor.default-dispatcher-2] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Storing token to store : 'IMap{name='oAuthAccessToken'}' with key : ''
12:24:05.035 [hz.main.cached.thread-7] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'oAuthAccessToken_token' }
12:24:05.035 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthAccessToken_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:05.036 [hz.main.cached.thread-7] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:05.036 [hz.main.cached.thread-5] INFO  i.v.p.impl.PersistenceMapStore - LoadAll { 'mapName' : 'oAuthAccessToken_token' }
12:24:05.037 [hz.main.cached.thread-5] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthAccessToken_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:05.038 [hz.main.cached.thread-5] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:05.041 [hz.main.partition-operation.thread-46] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3' }
12:24:05.043 [hz.main.partition-operation.thread-46] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthAccessToken_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:05.044 [hz.main.partition-operation.thread-46] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:05.046 [hz.main.cached.thread-12] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'oAuthAccessToken_refresh_token' }
12:24:05.047 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthAccessToken_refresh_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:05.047 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:05.048 [hz.main.cached.thread-4] INFO  i.v.p.impl.PersistenceMapStore - LoadAll { 'mapName' : 'oAuthAccessToken_refresh_token' }
12:24:05.049 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthAccessToken_refresh_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:05.050 [hz.main.cached.thread-4] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:05.051 [hz.main.partition-operation.thread-43] INFO  i.v.p.impl.PersistenceMapStore - load { 'key' : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ' }
12:24:05.051 [hz.main.partition-operation.thread-43] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='oAuthAccessToken_refresh_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:05.052 [hz.main.partition-operation.thread-43] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:05.052 [main-system-akka.actor.default-dispatcher-2] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Stored token to store : 'IMap{name='oAuthAccessToken'}' with key : ''
12:24:05.339 [main-system-akka.actor.default-dispatcher-4] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:05.342 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved accessToken token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3600),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:05.342 [main-system-akka.actor.default-dispatcher-4] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:05.344 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved authInfo for token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3600),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:05.360 [main-system-akka.actor.default-dispatcher-4] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:05.361 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved accessToken token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3600),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:05.361 [main-system-akka.actor.default-dispatcher-4] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:05.361 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved authInfo for token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3600),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:05.366 [scala-execution-context-global-214] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:24:09.276 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:09.277 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:24:10.036 [hz.main.cached.thread-12] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3', 'size of value' : '' }
12:24:10.037 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='oAuthAccessToken_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:10.038 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:10.047 [hz.main.cached.thread-12] INFO  i.v.p.impl.PersistenceMapStore - Storing to persistence { 'key' : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ', 'size of value' : '' }
12:24:10.048 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Sending command {findandmodify : BsonString{value='oAuthAccessToken_refresh_token'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:10.048 [hz.main.cached.thread-12] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:10.802 [main-system-akka.actor.default-dispatcher-30] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:10.802 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved accessToken token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3595),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:10.803 [main-system-akka.actor.default-dispatcher-30] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:10.803 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved authInfo for token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3595),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:10.804 [main-system-akka.actor.default-dispatcher-30] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:10.804 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved accessToken token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3595),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:10.805 [main-system-akka.actor.default-dispatcher-30] DEBUG i.v.p.o.impl.TokenPersistenceImpl - Retrieving store : 'IMap{name='oAuthAccessToken'}' with token : 'cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3'
data 
12:24:10.805 [main-system-akka.actor.default-dispatcher-30] INFO  io.vamp.oauth.OAuth2DataHanlder - Retrieved authInfo for token AccessToken(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OjlzbXZTRWhNcW9INGlhVEZYTGc3,Some(cm9vdDpmcm9udGVuZDoxNTMyNTIxNDQ1MDI5OnJkcmtXRkU5WURlbTc3ZmFyTGlQ),None,Some(3595),Wed Jul 25 12:24:05 GMT 2018,Map())
12:24:10.806 [scala-execution-context-global-214] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:24:19.277 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:19.278 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:24:29.278 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Checking status of mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:29.279 [cluster-ClusterId{value='5b58690f26853c00012b4bfb', description='null'}-mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017] DEBUG org.mongodb.driver.cluster - Updating cluster description to  {type=REPLICA_SET, servers=[{address=mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, roundTripTime=0.6 ms, state=CONNECTED}]
12:24:29.456 [hz.main.cached.thread-12] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: root
12:24:29.457 [hz.main.cached.thread-12] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - DefaultRootPolicyExecutor triggered for root
Jul 25, 2018 12:24:29 PM com.hazelcast.map.impl.recordstore.DefaultRecordStore
INFO: [10.20.30.229]:5701 [vamp-group] [3.9.1] Starting to load all keys for map project on partitionId=28
12:24:29.457 [hz.main.cached.thread-18] INFO  i.v.p.impl.PersistenceMapStore - LoadAllKeys { 'mapName' : 'project' }
12:24:29.458 [hz.main.cached.thread-18] DEBUG org.mongodb.driver.protocol.command - Sending command {find : BsonString{value='project'}} to database vamp on connection [connectionId{localValue:6, serverValue:6}] to server mongo-0.vamp-mongodb.vamp-system.svc.cluster.local:27017
12:24:29.458 [hz.main.cached.thread-18] DEBUG org.mongodb.driver.protocol.command - Command execution completed
12:24:29.469 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for project default
12:24:29.469 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultRootPolicyExecutor - Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false))
12:24:29.470 [hz.main.cached.thread-18] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: project
12:24:29.470 [scala-execution-context-global-214] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultRootPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Synching all projects: Stream(ProjectSpecification(default,1532510657104,Map(),Set(default),Set(),false)),false)))
12:24:29.470 [hz.main.cached.thread-18] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - DefaultProjectPolicy triggered for default
12:24:29.471 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.core.PolicyExecutorManager$ - Scheudling new job for cluster default
12:24:29.471 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.DefaultProjectPolicyExecutor - Sycnhed project status default - clusters: Set(default)
12:24:29.471 [scala-execution-context-global-214] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor DefaultProjectPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Sycnhed project status default - clusters: Set(default),false)))
12:24:29.471 [hz.main.cached.thread-18] INFO  io.vamp.core.PolicyExecutorManager$ - Handling new job with kind: cluster
12:24:29.471 [hz.main.cached.thread-18] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - IstioSetupClusterPolicy triggered for default
12:24:29.472 [scala-execution-context-global-214] DEBUG i.vamp.states.impl.DesiredStatesImpl - Get cluster with project=default,cluster=default
12:24:29.473 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - No cluster default in the cache
12:24:29.473 [scala-execution-context-global-214] INFO  i.v.d.i.k.KubernetesContainerDriver - Retrieving cluster default
12:24:29.477 [scala-execution-context-global-214] INFO  i.v.d.i.k.KubernetesContainerDriver - Virtual clusters retrieved Set(vamp-tutorial, vamp-tutorial-test)
12:24:29.477 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Retrieving initialization of gateway system
12:24:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Required deployments :List(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:24:29.485 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.d.impl.istio.IstioNetworkDriver - Actual deployments :ArrayBuffer(grafana, istio-citadel, istio-egressgateway, istio-ingressgateway, istio-pilot, istio-policy, istio-sidecar-injector, istio-statsd-prom-bridge, istio-telemetry, istio-tracing, prometheus, servicegraph, elasticsearch, fluentd-es, kibana)
12:24:29.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.vamp.states.impl.CurrentStatesImpl - Putting to the cache
12:24:29.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster found
12:24:29.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Cluster is initializing
12:24:29.486 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.p.e.i.IstioSetupClusterPolicyExecutor - Initializing cluster default
12:24:29.486 [scala-execution-context-global-214] INFO  io.vamp.core.PolicyExecutorManager$ - Policy executor IstioSetupClusterPolicyExecutor completed with result: PolicyExecutorResult(List(PolicyNotfication(Initializing cluster default,true)))
12:24:29.487 [main-system-akka.actor.default-dispatcher-4] INFO  i.v.n.impl.SlackNotification - New slack notification Initializing cluster default
12:24:29.487 [scala-execution-context-global-214] INFO  i.v.n.impl.UserNotification - New notification for datakey project=default,cluster=default will be sent to Some(UserNotificationRegistry(Set(root)))
12:24:29.487 [main-system-akka.actor.default-dispatcher-4] INFO  io.vamp.cluster.ClusterAccess$ - Couldn't find cluster access for key project=default,cluster=default will create a new one
12:24:29.488 [main-system-akka.actor.default-dispatcher-2] INFO  i.v.n.impl.UserNotification - Publishing to topic. Message: Initializing cluster default - Topic: root-notifications
avalcepina commented 6 years ago

It definitely looks like the cluster is not being initialized correctly, since you keep on getting messages that say it's trying to initialize. This might be caused by differences in the istio setup between the two versions you tried. I'd say you can try two things:

1) recreate the cluster and reinstall vamp lamia, letting it take care of istio setup from scratch. 2) check the resources in the istio-system to verify that all pods are running and all ips have been acquired. If that is not the case then that's the reason why you are having these problems. In that case just doing what I suggested on step 1 should fix it.

If you still have problems please send me some screenshots of the status of resources in the istio-system, especially those listed at the start of the readme

wansuiye commented 6 years ago

hi, @avalcepina ,I have compared the local istio and vamp2setup wiki, the difference is that there is no Prometheus -external and elasticsearch-external service local. I didn't find either in the official documentation, and as you can see from the istio-initialize log, vamp reinstated istio.

I uninstalled istio and reinstalled istio using vamp (istio-initalize), which works this time.

However, because I use externalips instead of loadbalancer, I need to modify the ingressgateway service and add some gateway, virtualservice and serviceentry. The strange thing is that this time I'm going to revisit the previous problem, and it doesn't work to create a namespace.

I don't understand why vamp strictly requires istio components, and when I modify the definition of ingressgateway service, it affects the creation of cluster. It is quite common to customize components in real-world applications such as monitoring, logging, and so on

avalcepina commented 6 years ago

Hi @wansuiye , I understand your point, however keep in mind this is an alpha version and development is still ongoing. Large parts of the applications might change in the future. For the time being we require a precise Istio setup that meets certain standards, simply because we didn't have time yet to support all the options and also because Istio itself is changing rapidly as we work on it, so it wouldn't make much sense to optimise the way we manage it right now. In the future (especially after Istio 1.0.0 is released) we will probably look into enabling different setups and customisations. At this time, unfortunately, I don’t think we can change our current requirements. Also, as a last note, if I understood your explanation correctly you only changed the ingressgateway definition. That on itself should not affect cluster initialisation, provided you kept the same name. There's maybe something else that is causing the problem. In the future we will also try to provide better notifications while initialising the cluster, so that it's clearer what the problem is. Anyhow, a custom ingressgateway definition will not work with the gateways Vamp Lamia creates. Please let me know if you need further help and also if you have more feedback, it is always appreciated :)

avalcepina commented 5 years ago

Closing due to inactivity