solo-io / gloo

The Feature-rich, Kubernetes-native, Next-Generation API Gateway Built on Envoy
https://docs.solo.io/
Apache License 2.0
4.08k stars 437 forks source link

gRPC Example hang #99

Closed jeanlucmongrain closed 6 years ago

jeanlucmongrain commented 6 years ago

Trying https://github.com/solo-io/gloo/tree/master/example/grpc with latest version of Virtualbox, Minikube, kubectl, glooctl on a blank minikube.

at this step:

[07:01] curl $GRPC_URL/bookstore.Bookstore/ListShelves
curl: (7) Failed to connect to 10.0.2.15 port 30508: Connection timed out
[07:06] 

Logs

Bookstore

2018/05/30 06:57:59 listening on 8080
2018/05/30 06:58:15 /grpc.reflection.v1alpha.ServerReflection/ServerReflectionInfo

kube-ingress

ERROR: logging before flag.Parse: W0530 06:46:01.324885       1 client_config.go:529] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
ERROR: logging before flag.Parse: W0530 06:46:01.326152       1 client_config.go:529] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/pkg/storage/crd/crd_storage_client.go:103"  registering crd v1.crd{
  Plural:    "upstreams",
  Group:     "gloo.solo.io",
  Version:   "v1",
  Kind:      "Upstream",
  ShortName: "us",
}
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/pkg/storage/crd/crd_storage_client.go:103"  registering crd v1.crd{
  Plural:    "virtualservices",
  Group:     "gloo.solo.io",
  Version:   "v1",
  Kind:      "VirtualService",
  ShortName: "vs",
}
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/pkg/storage/crd/crd_storage_client.go:103"  registering crd v1.crd{
  Plural:    "virtualmeshes",
  Group:     "gloo.solo.io",
  Version:   "v1",
  Kind:      "VirtualMesh",
  ShortName: "vm",
}
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/cmd/kube-ingress-controller/main.go:105"    starting ingress controller
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:113" Starting "gloo-ingress-syncer" controller
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:116" Waiting for informer caches to sync
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/cmd/kube-ingress-controller/main.go:81" starting ingress status sync
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/cmd/kube-ingress-controller/main.go:94" starting ingress sync
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:113" Starting "kube-ingress-controller" controller
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:116" Waiting for informer caches to sync
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:121" Starting workers
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:127" Started workers
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:121" Starting workers
"Wed, 30 May 2018 06:46:01 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:127" Started workers

control-plane

non stop flow of:

ERROR: logging before flag.Parse: E0530 07:11:03.617946       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:04.620914       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:05.623252       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:06.626267       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:07.628632       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:08.633828       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:09.650339       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:10.653396       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"
ERROR: logging before flag.Parse: E0530 07:11:11.655923       1 reflector.go:205] github.com/solo-io/gloo/pkg/storage/crd/roles.go:84: Failed to list *v1.Role: roles.gloo.solo.io is forbidden: User "system:serviceaccount:gloo-system:default" cannot list roles.gloo.solo.io in the namespace "gloo-system"

ingress

[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:200] initializing epoch 0 (hot restart version=9.200.16384.127.options=capacity=16384, num_slots=8209 hash=228984379728933363)
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:202] statically linked extensions:
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:204]   access_loggers: envoy.file_access_log,envoy.http_grpc_access_log
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:207]   filters.http: envoy.buffer,envoy.cors,envoy.ext_authz,envoy.fault,envoy.grpc_http1_bridge,envoy.grpc_json_transcoder,envoy.grpc_web,envoy.gzip,envoy.health_check,envoy.http_dynamo_filter,envoy.ip_tagging,envoy.lua,envoy.rate_limit,envoy.router,envoy.squash,io.solo.azure_functions,io.solo.function_router,io.solo.gcloudfunc,io.solo.lambda,io.solo.nats_streaming,io.solo.transformation
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:210]   filters.listener: envoy.listener.original_dst,envoy.listener.proxy_protocol
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:213]   filters.network: envoy.client_ssl_auth,envoy.echo,envoy.ext_authz,envoy.http_connection_manager,envoy.mongo_proxy,envoy.ratelimit,envoy.redis_proxy,envoy.tcp_proxy
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:215]   stat_sinks: envoy.dog_statsd,envoy.metrics_service,envoy.statsd
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:217]   tracers: envoy.dynamic.ot,envoy.lightstep,envoy.zipkin
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:220]   transport_sockets.downstream: raw_buffer,ssl
[2018-05-30 06:46:50.281][1][info][main] external/envoy/source/server/server.cc:223]   transport_sockets.upstream: raw_buffer,ssl
[2018-05-30 06:46:50.294][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:46:50.294][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:46:50.294][1][info][config] external/envoy/source/server/configuration_impl.cc:52] loading 0 listener(s)
[2018-05-30 06:46:50.294][1][info][config] external/envoy/source/server/configuration_impl.cc:92] loading tracing configuration
[2018-05-30 06:46:50.294][1][info][config] external/envoy/source/server/configuration_impl.cc:114] loading stats sink configuration
[2018-05-30 06:46:50.294][1][info][main] external/envoy/source/server/server.cc:399] starting main dispatch loop
[2018-05-30 06:46:55.295][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:46:55.296][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:00.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:00.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:05.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:05.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:10.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:10.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:15.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:15.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:20.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:20.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:25.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:25.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:30.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:30.297][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:35.299][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:35.299][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:40.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:40.298][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:45.299][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:224] gRPC config stream closed: 1, 
[2018-05-30 06:47:45.299][1][warning][upstream] external/envoy/source/common/config/grpc_mux_impl.cc:39] Unable to establish new stream
[2018-05-30 06:47:47.799][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:127] cm init: initializing cds
[2018-05-30 06:47:50.313][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:379] add/update cluster gloo-system-control-plane-8081 during init
[2018-05-30 06:47:50.317][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:379] add/update cluster gloo-system-ingress-8080 during init
[2018-05-30 06:47:50.320][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:379] add/update cluster gloo-system-ingress-8443 during init
[2018-05-30 06:47:50.321][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:108] cm init: initializing secondary clusters
[2018-05-30 06:47:50.324][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:131] cm init: all clusters initialized
[2018-05-30 06:47:50.324][1][info][main] external/envoy/source/server/server.cc:383] all clusters initialized. initializing init manager
[2018-05-30 06:47:50.325][1][info][config] external/envoy/source/server/listener_manager_impl.cc:602] all dependencies initialized. starting workers
[2018-05-30 06:57:32.189][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:385] add/update cluster default-grpc-bookstore-8080 starting warming
[2018-05-30 06:57:32.189][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:392] warming cluster default-grpc-bookstore-8080 complete
[2018-05-30 06:58:15.764][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:385] add/update cluster default-grpc-bookstore-8080 starting warming
[2018-05-30 06:58:15.764][1][info][upstream] external/envoy/source/common/upstream/cluster_manager_impl.cc:392] warming cluster default-grpc-bookstore-8080 complete
[2018-05-30 07:02:50.326][1][info][main] external/envoy/source/server/drain_manager_impl.cc:63] shutting down parent after drain

function-discovery

"Wed, 30 May 2018 06:58:15 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:58:15 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:58:15 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:58:15 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:256" updated upstream &v1.Upstream{
  Name:              "default-grpc-bookstore-8080",
  Type:              "kubernetes",
  ConnectionTimeout: 0,
  Spec:              &types.Struct{
    Fields: {
      "service_port": &types.Value{
        Kind: &types.Value_NumberValue{
          NumberValue: 8080.000000,
        },
      },
      "service_name": &types.Value{
        Kind: &types.Value_StringValue{
          StringValue: "grpc-bookstore",
        },
      },
      "service_namespace": &types.Value{
        Kind: &types.Value_StringValue{
          StringValue: "default",
        },
      },
    },
  },
  Functions:   []*v1.Function{},
  ServiceInfo: &v1.ServiceInfo{
    Type:       "gRPC",
    Properties: &types.Struct{
      Fields: {
        "descriptors_file_ref": &types.Value{
          Kind: &types.Value_StringValue{
            StringValue: "grpc-discovery:Bookstore.descriptors",
          },
        },
        "service_names": &types.Value{
          Kind: &types.Value_ListValue{
            ListValue: &types.ListValue{
              Values: []*types.Value{
                &types.Value{
                  Kind: &types.Value_StringValue{
                    StringValue: "Bookstore",
                  },
                },
              },
            },
          },
        },
      },
    },
  },
  Status: &v1.Status{
    State:  1,
    Reason: "",
  },
  Metadata: &v1.Metadata{
    ResourceVersion: "1518",
    Namespace:       "gloo-system",
    Annotations:     {
      "generated_by":                                     "kubernetes-upstream-discovery",
      "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"v1\",\"kind\":\"Service\",\"metadata\":{\"annotations\":{},\"labels\":{\"sevice\":\"grpc-bookstore\"},\"name\":\"grpc-bookstore\",\"namespace\":\"default\"},\"spec\":{\"ports\":[{\"port\":8080,\"protocol\":\"TCP\"}],\"selector\":{\"app\":\"grpc-bookstore\"},\"type\":\"LoadBalancer\"}}\n",
      "gloo.solo.io/discovery-type":                      "grpc",
    },
  },
}
"Wed, 30 May 2018 06:58:15 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 06:58:15 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 06:58:16 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 06:58:16 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:112"    beginning update for []string{
  "gloo-system-control-plane-8081",
  "gloo-system-ingress-8080",
  "gloo-system-ingress-8443",
  "default-grpc-bookstore-8080",
} upstreams: 4
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:112"    beginning update for []string{
  "gloo-system-control-plane-8081",
  "gloo-system-ingress-8080",
  "gloo-system-ingress-8443",
  "default-grpc-bookstore-8080",
} upstreams: 4
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:112"    beginning update for []string{
  "gloo-system-control-plane-8081",
  "gloo-system-ingress-8080",
  "gloo-system-ingress-8443",
  "default-grpc-bookstore-8080",
} upstreams: 4
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:112"    beginning update for []string{
  "gloo-system-control-plane-8081",
  "gloo-system-ingress-8080",
  "gloo-system-ingress-8443",
  "default-grpc-bookstore-8080",
} upstreams: 4
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:112"    beginning update for []string{
  "gloo-system-control-plane-8081",
  "gloo-system-ingress-8080",
  "gloo-system-ingress-8443",
  "default-grpc-bookstore-8080",
} upstreams: 4
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:44 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:45 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:45 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:45 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:45 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:47 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:47 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:48 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:48 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:48 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:48 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:49 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:49 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:49 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:49 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:49 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:50 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:50 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:50 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:50 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "default-grpc-bookstore-8080"
"Wed, 30 May 2018 07:15:51 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:51 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:51 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:51 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:51 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:51 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 07:15:52 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 07:15:52 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 07:15:52 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"

Upstream Discovery

ERROR: logging before flag.Parse: W0530 06:46:11.927839       1 client_config.go:529] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
"Wed, 30 May 2018 06:46:11 UTC: github.com/solo-io/gloo/pkg/storage/crd/crd_storage_client.go:103"  registering crd v1.crd{
  Plural:    "upstreams",
  Group:     "gloo.solo.io",
  Version:   "v1",
  Kind:      "Upstream",
  ShortName: "us",
}
"Wed, 30 May 2018 06:46:11 UTC: github.com/solo-io/gloo/pkg/storage/crd/crd_storage_client.go:103"  registering crd v1.crd{
  Plural:    "virtualservices",
  Group:     "gloo.solo.io",
  Version:   "v1",
  Kind:      "VirtualService",
  ShortName: "vs",
}
"Wed, 30 May 2018 06:46:11 UTC: github.com/solo-io/gloo/pkg/storage/crd/crd_storage_client.go:103"  registering crd v1.crd{
  Plural:    "virtualmeshes",
  Group:     "gloo.solo.io",
  Version:   "v1",
  Kind:      "VirtualMesh",
  ShortName: "vm",
}
2018/05/30 06:46:11 starting kubernetes service discovery
"Wed, 30 May 2018 06:46:11 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:113" Starting "kube-upstream-discovery" controller
"Wed, 30 May 2018 06:46:11 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:116" Waiting for informer caches to sync
"Wed, 30 May 2018 06:46:12 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:121" Starting workers
"Wed, 30 May 2018 06:46:12 UTC: github.com/solo-io/gloo/vendor/github.com/solo-io/kubecontroller/controller.go:127" Started workers
"Wed, 30 May 2018 06:46:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:46:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:47:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:47:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:47:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:48:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:48:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:48:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:49:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:49:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:49:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:50:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:50:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:50:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:51:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:51:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:51:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:52:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:52:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:52:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:53:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:53:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:53:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:54:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:54:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:54:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:55:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:55:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:55:12 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:56:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 06:56:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 06:56:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 06:57:11 UTC: github.com/solo-io/gloo/pkg/config/desired_state.go:101"    updating upstream "gloo-system-control-plane-8081"
ilackarms commented 6 years ago

are you able to ping 10.0.2.15? that looks like an internal NAT ip that virtualbox assigns; it might be unreachable from your host (unless you ssh inside your minikube vm and run commands from there)

jeanlucmongrain commented 6 years ago

ah that is right, the pod address is not reachable from the host.

I thought that minikube was taking care of such as simple use case

jeanlucmongrain commented 6 years ago

a simple ip route add 10.0.0.0/8 via $IP_VM did the trick.

$ ping 10.0.2.15
PING 10.0.2.15 (10.0.2.15) 56(84) bytes of data.
64 bytes from 10.0.2.15: icmp_seq=1 ttl=64 time=0.451 ms
^C
--- 10.0.2.15 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.451/0.451/0.451/0.000 ms

try to connect to it:

$ curl --output - $GRPC_URL
curl: (56) Recv failure: Connection reset by peer

$ telnet 10.0.2.15 32688
Trying 10.0.2.15...
Connected to 10.0.2.15.
Escape character is '^]'.
dsfafdas
dsf
^C
^]
telnet> quit
Connection closed.

$ curl --output - $GRPC_URL/bookstore.Bookstore/ListShelves
curl: (56) Recv failure: Connection reset by peer

I don't see anything different in the logs for function-discovery

"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:44 UTC: github.com/solo-io/gloo/internal/function-discovery/nats-streaming/discover_nats.go:34" attempting to detect NATS for "gloo-system-control-plane-8081"
WARNING: "Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/cmd/function-discovery/main.go:43" discovery error: &errors.withStack{
  error: &errors.withMessage{
    cause: &errors.withStack{
      error: &errors.withMessage{
        cause: &errors.fundamental{
          msg:   "service type detection failed for gloo-system-control-plane-8081: 5 errors occurred:\n\n* not an openfaas upstream\n* not a fission upstream\n* listing services. are you sure control-plane.gloo-system.svc.cluster.local:8081 implements reflection?: rpc error: code = Unimplemented desc = unknown service grpc.reflection.v1alpha.ServerReflection\n* service at control-plane.gloo-system.svc.cluster.local:8081 does not implement swagger at a known endpoint, or was unreachable: 5 errors occurred:\n\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/swagger.json: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/swagger/docs/v1: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/swagger/docs/v2: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/v1/swagger: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/v2/swagger: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* failed to connect to nats-streaming cluster: read tcp 172.17.0.5:36154->10.111.199.192:8081: i/o timeout",
          stack: &errors.stack{
            0x11447bf,
            0x13d3f4a,
            0x141f9ce,
            0x141fe00,
            0x455ac1,
          },
        },
        msg: "failed to discover whether gloo-system-control-plane-8081 is a functional upstream",
      },
      stack: &errors.stack{
        0x13d4019,
        0x141f9ce,
        0x141fe00,
        0x455ac1,
      },
    },
    msg: "updating upstream gloo-system-control-plane-8081",
  },
  stack: &errors.stack{
    0x141fbee,
    0x141fe00,
    0x455ac1,
  },
}
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:48 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:48 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:48 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64"    no more retries for "gloo-system-control-plane-8081"
ilackarms commented 6 years ago

can you show:

glooctl upstream get
glooctl virtualservice get
jeanlucmongrain commented 6 years ago
$ glooctl upstream get
+--------------------------------+------------+----------+----------+
|              NAME              |    TYPE    |  STATUS  | FUNCTION |
+--------------------------------+------------+----------+----------+
| default-grpc-bookstore-8080    | gRPC       | Accepted |          |
| gloo-system-control-plane-8081 | kubernetes | Accepted |          |
| gloo-system-ingress-8080       | kubernetes | Accepted |          |
| gloo-system-ingress-8443       | kubernetes | Accepted |          |
+--------------------------------+------------+----------+----------+
$ glooctl virtualservice get
+-----------------+--------+-----+--------+---------+------+------+--------+----------+----------+-----------+
| VIRTUAL SERVICE | DOMAIN | SSL | STATUS | MATCHER | TYPE | VERB | HEADER | UPSTREAM | FUNCTION | EXTENSION |
+-----------------+--------+-----+--------+---------+------+------+--------+----------+----------+-----------+
+-----------------+--------+-----+--------+---------+------+------+--------+----------+----------+-----------+
ilackarms commented 6 years ago

you have no virtualservices defined. no virtualservice means no routes, which means Envoy isn't even listening (you'll get connection refused).

have you tried glooctl route create yet?

ilackarms commented 6 years ago

btw if you pull a new image of gloo (redo the kubectl apply -f install/kube/install.yaml

jeanlucmongrain commented 6 years ago

ok I think I found where I screw up thanks