Closed jeanlucmongrain closed 6 years ago
are you able to ping 10.0.2.15
? that looks like an internal NAT ip that virtualbox assigns; it might be unreachable from your host (unless you ssh inside your minikube vm and run commands from there)
ah that is right, the pod address is not reachable from the host.
I thought that minikube was taking care of such as simple use case
a simple ip route add 10.0.0.0/8 via $IP_VM
did the trick.
$ ping 10.0.2.15
PING 10.0.2.15 (10.0.2.15) 56(84) bytes of data.
64 bytes from 10.0.2.15: icmp_seq=1 ttl=64 time=0.451 ms
^C
--- 10.0.2.15 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.451/0.451/0.451/0.000 ms
try to connect to it:
$ curl --output - $GRPC_URL
curl: (56) Recv failure: Connection reset by peer
$ telnet 10.0.2.15 32688
Trying 10.0.2.15...
Connected to 10.0.2.15.
Escape character is '^]'.
dsfafdas
dsf
^C
^]
telnet> quit
Connection closed.
$ curl --output - $GRPC_URL/bookstore.Bookstore/ListShelves
curl: (56) Recv failure: Connection reset by peer
I don't see anything different in the logs for function-discovery
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:39 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:40 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:41 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:42 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8080"
"Wed, 30 May 2018 14:38:43 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-ingress-8443"
"Wed, 30 May 2018 14:38:44 UTC: github.com/solo-io/gloo/internal/function-discovery/nats-streaming/discover_nats.go:34" attempting to detect NATS for "gloo-system-control-plane-8081"
WARNING: "Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/cmd/function-discovery/main.go:43" discovery error: &errors.withStack{
error: &errors.withMessage{
cause: &errors.withStack{
error: &errors.withMessage{
cause: &errors.fundamental{
msg: "service type detection failed for gloo-system-control-plane-8081: 5 errors occurred:\n\n* not an openfaas upstream\n* not a fission upstream\n* listing services. are you sure control-plane.gloo-system.svc.cluster.local:8081 implements reflection?: rpc error: code = Unimplemented desc = unknown service grpc.reflection.v1alpha.ServerReflection\n* service at control-plane.gloo-system.svc.cluster.local:8081 does not implement swagger at a known endpoint, or was unreachable: 5 errors occurred:\n\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/swagger.json: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/swagger/docs/v1: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/swagger/docs/v2: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/v1/swagger: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* could not perform HTTP GET on resolved addr: control-plane.gloo-system.svc.cluster.local:8081: Get http://control-plane.gloo-system.svc.cluster.local:8081/v2/swagger: net/http: HTTP/1.x transport connection broken: malformed HTTP response \"\\x00\\x00\\x00\\x04\\x00\\x00\\x00\\x00\\x00\"\n* failed to connect to nats-streaming cluster: read tcp 172.17.0.5:36154->10.111.199.192:8081: i/o timeout",
stack: &errors.stack{
0x11447bf,
0x13d3f4a,
0x141f9ce,
0x141fe00,
0x455ac1,
},
},
msg: "failed to discover whether gloo-system-control-plane-8081 is a functional upstream",
},
stack: &errors.stack{
0x13d4019,
0x141f9ce,
0x141fe00,
0x455ac1,
},
},
msg: "updating upstream gloo-system-control-plane-8081",
},
stack: &errors.stack{
0x141fbee,
0x141fe00,
0x455ac1,
},
}
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:46 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:47 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:48 UTC: github.com/solo-io/gloo/internal/function-discovery/eventloop/event_loop.go:98" attempting update for "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:48 UTC: github.com/solo-io/gloo/internal/function-discovery/updater/updater.go:222" attempting to apply update for upstream "gloo-system-control-plane-8081"
"Wed, 30 May 2018 14:38:48 UTC: github.com/solo-io/gloo/internal/function-discovery/detector/detector.go:64" no more retries for "gloo-system-control-plane-8081"
can you show:
glooctl upstream get
glooctl virtualservice get
$ glooctl upstream get
+--------------------------------+------------+----------+----------+
| NAME | TYPE | STATUS | FUNCTION |
+--------------------------------+------------+----------+----------+
| default-grpc-bookstore-8080 | gRPC | Accepted | |
| gloo-system-control-plane-8081 | kubernetes | Accepted | |
| gloo-system-ingress-8080 | kubernetes | Accepted | |
| gloo-system-ingress-8443 | kubernetes | Accepted | |
+--------------------------------+------------+----------+----------+
$ glooctl virtualservice get
+-----------------+--------+-----+--------+---------+------+------+--------+----------+----------+-----------+
| VIRTUAL SERVICE | DOMAIN | SSL | STATUS | MATCHER | TYPE | VERB | HEADER | UPSTREAM | FUNCTION | EXTENSION |
+-----------------+--------+-----+--------+---------+------+------+--------+----------+----------+-----------+
+-----------------+--------+-----+--------+---------+------+------+--------+----------+----------+-----------+
you have no virtualservices defined. no virtualservice means no routes, which means Envoy isn't even listening (you'll get connection refused).
have you tried glooctl route create
yet?
btw if you pull a new image of gloo (redo the kubectl apply -f install/kube/install.yaml
ok I think I found where I screw up thanks
Trying https://github.com/solo-io/gloo/tree/master/example/grpc with latest version of Virtualbox, Minikube,
kubectl
,glooctl
on a blank minikube.at this step:
Logs
Bookstore
kube-ingress
control-plane
non stop flow of:
ingress
function-discovery
Upstream Discovery