osrg / goplane

an agent for configuring linux network stack via GoBGP
http://osrg.github.io/gobgp/
119 stars 26 forks source link

evpn_vxlan_test don't work #19

Closed kak2zz closed 7 years ago

kak2zz commented 7 years ago

Hello! evpn_vxlan_test don't work for me

:~# docker ps
CONTAINER ID        IMAGE               COMMAND                  CREATED             STATUS              PORTS               NAMES
0837c09748d8        osrg/gobgp          "/usr/bin/supervisord"   3 seconds ago       Up 3 seconds                            j3
435b867adea9        osrg/gobgp          "/usr/bin/supervisord"   7 seconds ago       Up 6 seconds                            j2
1890ca16a0df        osrg/gobgp          "/usr/bin/supervisord"   10 seconds ago      Up 9 seconds                            j1
a0e66dfc8715        osrg/gobgp          "/usr/bin/supervisord"   14 seconds ago      Up 13 seconds                           h3
26fa4181baff        osrg/gobgp          "/usr/bin/supervisord"   17 seconds ago      Up 16 seconds                           h2
490c89af88d2        osrg/gobgp          "/usr/bin/supervisord"   21 seconds ago      Up 20 seconds                           h1
4098757a89d1        osrg/goplane        "/usr/bin/supervisord"   25 seconds ago      Up 24 seconds                           g3
06213029f0f8        osrg/goplane        "/usr/bin/supervisord"   28 seconds ago      Up 27 seconds                           g2
bbc4cca6434d        osrg/goplane        "/usr/bin/supervisord"   33 seconds ago      Up 32 seconds                           g1

:~# docker exec -it g1 gobgp neighbor
Peer            AS Up/Down State       |#Advertised Received Accepted
192.168.10.3 65000   never Active      |          0        0        0
192.168.10.4 65000   never Active      |          0        0        0

:~# docker exec -it g2 gobgp neighbor
2017/02/02 08:31:43 grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 127.0.0.1:50051: getsockopt: connection refused"; Reconnecting to {"127.0.0.1:50051" <nil>}
grpc: timed out when dialing

:~# docker exec -it g3 gobgp neighbor
2017/02/02 08:31:49 grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 127.0.0.1:50051: getsockopt: connection refused"; Reconnecting to {"127.0.0.1:50051" <nil>}
grpc: timed out when dialing

could you help me?

ishidawataru commented 7 years ago

@kak2zz Please paste log files here. They are located under /tmp/goplane/

kak2zz commented 7 years ago

@ishidawataru this log from g1:

time="2017-02-03T07:24:04Z" level=info msg="Peer 192.168.10.4 is added"
time="2017-02-03T07:24:04Z" level=debug msg="failed to set md5 192.168.10.4 no such file or directory" Topic=Peer
time="2017-02-03T07:24:04Z" level=info msg="Add a peer configuration for:192.168.10.4" Topic=Peer
time="2017-02-03T07:24:04Z" level=info msg="Peer 192.168.10.3 is added"
time="2017-02-03T07:24:04Z" level=debug msg="failed to set md5 192.168.10.3 no such file or directory" Topic=Peer
time="2017-02-03T07:24:04Z" level=info msg="Add a peer configuration for:192.168.10.3" Topic=Peer
time="2017-02-03T07:24:04Z" level=debug msg="new dataplane: netlink"
time="2017-02-03T07:24:04Z" level=info msg="VirtualNetwork 65000:10 is added"
time="2017-02-03T07:24:04Z" level=debug msg="IdleHoldTimer expired" Duration=0 Key=192.168.10.3 Topic=Peer
time="2017-02-03T07:24:04Z" level=debug msg="state changed" Key=192.168.10.3 Topic=Peer new="BGP_FSM_ACTIVE" old="BGP_FSM_IDLE" reason=idle-hold-timer-expired
time="2017-02-03T07:24:04Z" level=debug msg="IdleHoldTimer expired" Duration=0 Key=192.168.10.4 Topic=Peer
time="2017-02-03T07:24:04Z" level=debug msg="state changed" Key=192.168.10.4 Topic=Peer new="BGP_FSM_ACTIVE" old="BGP_FSM_IDLE" reason=idle-hold-timer-expired
time="2017-02-03T07:24:04Z" level=debug msg="add route to lo"
time="2017-02-03T07:24:04Z" level=debug msg="create Destination" Key="192.168.0.1/32" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="Processing destination" Key="192.168.0.1/32" Topic=table
time="2017-02-03T07:24:04Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:04Z" level=info msg="VirtualNetwork 65000:20 is added"
time="2017-02-03T07:24:04Z" level=debug msg="vtep intf: vtep20"
time="2017-02-03T07:24:04Z" level=debug msg="add br20"
time="2017-02-03T07:24:04Z" level=debug msg="add vtep20"
time="2017-02-03T07:24:04Z" level=debug msg="vtep intf: vtep10"
time="2017-02-03T07:24:04Z" level=debug msg="add br10"
time="2017-02-03T07:24:04Z" level=debug msg="add vtep10"
time="2017-02-03T07:24:04Z" level=debug msg="add vrf" ExportRt=[65000:20] ImportRt=[65000:20] Key="65000:20" Rd=65000:20 Topic=Vrf
time="2017-02-03T07:24:04Z" level=debug msg="create Destination" Key="65000:65000:20" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="Processing destination" Key="65000:65000:20" Topic=table
time="2017-02-03T07:24:04Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="create Destination" Key="[type:multicast][rd:65000:20][etag:20][ip:192.168.0.1]" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="Processing destination" Key="[type:multicast][rd:65000:20][etag:20][ip:192.168.0.1]" Topic=table
time="2017-02-03T07:24:04Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="monitoring: eth3, index: 27" Etag=20 Topic=VirtualNetwork
time="2017-02-03T07:24:04Z" level=debug msg="add vrf" ExportRt=[65000:10] ImportRt=[65000:10] Key="65000:10" Rd=65000:10 Topic=Vrf
time="2017-02-03T07:24:04Z" level=debug msg="create Destination" Key="65000:65000:10" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="Processing destination" Key="65000:65000:10" Topic=table
time="2017-02-03T07:24:04Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="create Destination" Key="[type:multicast][rd:65000:10][etag:10][ip:192.168.0.1]" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="Processing destination" Key="[type:multicast][rd:65000:10][etag:10][ip:192.168.0.1]" Topic=table
time="2017-02-03T07:24:04Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="monitoring: eth2, index: 12" Etag=10 Topic=VirtualNetwork
time="2017-02-03T07:24:04Z" level=debug msg="mac: aa:aa:aa:aa:aa:01, ip: <nil>, index: 27, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-03T07:24:04Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:aa:aa:aa:aa:aa:01][ip:<nil>][labels:[20]]" Topic=Table
time="2017-02-03T07:24:04Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:aa:aa:aa:aa:aa:01][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-03T07:24:04Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:06Z" level=debug msg="mac: aa:aa:aa:aa:aa:01, ip: <nil>, index: 12, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-03T07:24:06Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:aa:aa:aa:aa:aa:01][ip:<nil>][labels:[10]]" Topic=Table
time="2017-02-03T07:24:06Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:aa:aa:aa:aa:aa:01][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-03T07:24:06Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:06Z" level=debug msg="mac: 46:12:2e:4d:60:b9, ip: <nil>, index: 12, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-03T07:24:06Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:46:12:2e:4d:60:b9][ip:<nil>][labels:[10]]" Topic=Table
time="2017-02-03T07:24:06Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:46:12:2e:4d:60:b9][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-03T07:24:06Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:07Z" level=debug msg="mac: 8e:2c:8e:47:0d:91, ip: <nil>, index: 27, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-03T07:24:07Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:8e:2c:8e:47:0d:91][ip:<nil>][labels:[20]]" Topic=Table
time="2017-02-03T07:24:07Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:8e:2c:8e:47:0d:91][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-03T07:24:07Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T07:24:28Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-03T07:24:29Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer

Unfortunately log directory for g2 and g3 contain only configuration file

:~# ls /tmp/goplane/g2/
goplane.conf
:~# ls /tmp/goplane/g3/
goplane.conf
ishidawataru commented 7 years ago

Hmm, it seems g2 and g3 fails to start gobgpd and goplaned inside the containers. Are there any logs displayed when you run evpn_vxlan_test.py

kak2zz commented 7 years ago

I see only this:

 :~/goplane/test/netlink# python evpn_vxlan_test.py

DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/g1?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=g1 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/g1/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1855
DEBUG:nsenter:Leaving net namespace 1855
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/g2?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=g2 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/g2/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1935
DEBUG:nsenter:Leaving net namespace 1935
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/g3?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=g3 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/g3/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2019
DEBUG:nsenter:Leaving net namespace 2019
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/h1?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=h1 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/h1/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/h1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2099
DEBUG:nsenter:Leaving net namespace 2099
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/h2?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=h2 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/h2/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/h2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2180
DEBUG:nsenter:Leaving net namespace 2180
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/h3?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=h3 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/h3/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/h3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2262
DEBUG:nsenter:Leaving net namespace 2262
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/j1?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=j1 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/j1/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/j1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2344
DEBUG:nsenter:Leaving net namespace 2344
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/j2?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=j2 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/j2/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/j2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2426
DEBUG:nsenter:Leaving net namespace 2426
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/json?all=1&limit=-1&trunc_cmd=0&size=0 HTTP/1.1" 200 None
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "DELETE /v1.24/containers/j3?force=True&link=False&v=False HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/create?name=j3 HTTP/1.1" 201 90
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/j3/start HTTP/1.1" 204 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/j3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2506
DEBUG:nsenter:Leaving net namespace 2506
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1855
DEBUG:nsenter:Leaving net namespace 1855
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1935
DEBUG:nsenter:Leaving net namespace 1935
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2019
DEBUG:nsenter:Leaving net namespace 2019
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1855
DEBUG:nsenter:Leaving net namespace 1855
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/h1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2099
DEBUG:nsenter:Leaving net namespace 2099
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1935
DEBUG:nsenter:Leaving net namespace 1935
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/h2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2180
DEBUG:nsenter:Leaving net namespace 2180
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2019
DEBUG:nsenter:Leaving net namespace 2019
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/h3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2262
DEBUG:nsenter:Leaving net namespace 2262
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1855
DEBUG:nsenter:Leaving net namespace 1855
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/j1/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2344
DEBUG:nsenter:Leaving net namespace 2344
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 1935
DEBUG:nsenter:Leaving net namespace 1935
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/j2/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2426
DEBUG:nsenter:Leaving net namespace 2426
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/g3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2019
DEBUG:nsenter:Leaving net namespace 2019
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "GET /v1.24/containers/j3/json HTTP/1.1" 200 None
DEBUG:nsenter:Entering net namespace 2506
DEBUG:nsenter:Leaving net namespace 2506
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/h1/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/1cf6f8bc25946f15b19df5a1a8301b3ade0863f431d22d6f84ec060c660b4d0d/start HTTP/1.1" 101 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/h2/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/73e452f0e11b162dbc964167a4030e64aa5b8d533b542e49ffbe7cd75b228e06/start HTTP/1.1" 101 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/h3/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/f137346dd15d53223b3df232948d510b23003218eeeeec1dedba686c01f31163/start HTTP/1.1" 101 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/j1/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/43470ff05202f90860fcdd836250155edfbd905175165445e281007d450dae0a/start HTTP/1.1" 101 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/j2/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/c1ecc71ac652de03ab3a5a13e1a82331035cfde1c106ae7b650f67a143675b31/start HTTP/1.1" 101 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/j3/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/5e6ef8877581a824da3d038a6c344924dab74344e21a7403e5f0b4a29cc3c72b/start HTTP/1.1" 101 0
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/containers/g1/exec HTTP/1.1" 201 74
DEBUG:requests.packages.urllib3.connectionpool:http://localhost:None "POST /v1.24/exec/1346887e67c24252d282bd7a6a73171c8d8592e910fd3a0a44323c27422b1b20/start HTTP/1.1" 200 0

UPDATE: I'm exec /root/shared_volume/start_goplane.sh manually in g2 container and receive next log:

time="2017-02-03T09:48:09Z" level=info msg="Peer 192.168.10.2 is added"
time="2017-02-03T09:48:09Z" level=debug msg="failed to set md5 192.168.10.2 no such file or directory" Topic=Peer
time="2017-02-03T09:48:09Z" level=info msg="Add a peer configuration for:192.168.10.2" Topic=Peer
time="2017-02-03T09:48:09Z" level=info msg="Peer 192.168.10.4 is added"
time="2017-02-03T09:48:09Z" level=debug msg="failed to set md5 192.168.10.4 no such file or directory" Topic=Peer
time="2017-02-03T09:48:09Z" level=info msg="Add a peer configuration for:192.168.10.4" Topic=Peer
time="2017-02-03T09:48:09Z" level=debug msg="new dataplane: netlink"
time="2017-02-03T09:48:09Z" level=info msg="VirtualNetwork 65000:10 is added"
2017/02/03 09:48:09 grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp :50051: getsockopt: connection refused"; Reconnecting to {":50051" <nil>}
time="2017-02-03T09:48:09Z" level=debug msg="IdleHoldTimer expired" Duration=0 Key=192.168.10.4 Topic=Peer
time="2017-02-03T09:48:09Z" level=debug msg="state changed" Key=192.168.10.4 Topic=Peer new="BGP_FSM_ACTIVE" old="BGP_FSM_IDLE" reason=idle-hold-timer-expired
time="2017-02-03T09:48:09Z" level=debug msg="IdleHoldTimer expired" Duration=0 Key=192.168.10.2 Topic=Peer
time="2017-02-03T09:48:09Z" level=debug msg="state changed" Key=192.168.10.2 Topic=Peer new="BGP_FSM_ACTIVE" old="BGP_FSM_IDLE" reason=idle-hold-timer-expired
time="2017-02-03T09:48:10Z" level=error msg="grpc: timed out when dialing"
time="2017-02-03T09:48:10Z" level=debug msg="BGP server is not ready..waiting..."
2017/02/03 09:48:10 transport: http2Server.HandleStreams failed to read frame: read tcp 127.0.0.1:50051->127.0.0.1:44098: read: connection reset by peer
time="2017-02-03T09:48:20Z" level=debug msg="add route to lo"
time="2017-02-03T09:48:20Z" level=info msg="VirtualNetwork 65000:20 is added"
time="2017-02-03T09:48:20Z" level=debug msg="create Destination" Key="192.168.0.2/32" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="Processing destination" Key="192.168.0.2/32" Topic=table
time="2017-02-03T09:48:20Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="vtep intf: vtep10"
time="2017-02-03T09:48:20Z" level=debug msg="add br10"
time="2017-02-03T09:48:20Z" level=debug msg="vtep intf: vtep20"
time="2017-02-03T09:48:20Z" level=debug msg="add br20"
time="2017-02-03T09:48:20Z" level=debug msg="add vtep10"
time="2017-02-03T09:48:20Z" level=debug msg="add vtep20"
time="2017-02-03T09:48:20Z" level=debug msg="add vrf" ExportRt=[65000:20] ImportRt=[65000:20] Key="65000:20" Rd=65000:20 Topic=Vrf
time="2017-02-03T09:48:20Z" level=debug msg="create Destination" Key="65000:65000:20" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="Processing destination" Key="65000:65000:20" Topic=table
time="2017-02-03T09:48:20Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="add vrf" ExportRt=[65000:10] ImportRt=[65000:10] Key="65000:10" Rd=65000:10 Topic=Vrf
time="2017-02-03T09:48:20Z" level=debug msg="create Destination" Key="65000:65000:10" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="Processing destination" Key="65000:65000:10" Topic=table
time="2017-02-03T09:48:20Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="create Destination" Key="[type:multicast][rd:65000:20][etag:20][ip:192.168.0.2]" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="Processing destination" Key="[type:multicast][rd:65000:20][etag:20][ip:192.168.0.2]" Topic=table
time="2017-02-03T09:48:20Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="monitoring: eth3, index: 158" Etag=20 Topic=VirtualNetwork
time="2017-02-03T09:48:20Z" level=debug msg="create Destination" Key="[type:multicast][rd:65000:10][etag:10][ip:192.168.0.2]" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="Processing destination" Key="[type:multicast][rd:65000:10][etag:10][ip:192.168.0.2]" Topic=table
time="2017-02-03T09:48:20Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-03T09:48:20Z" level=debug msg="monitoring: eth2, index: 143" Etag=10 Topic=VirtualNetwork
time="2017-02-03T09:48:29Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-03T09:48:33Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
ishidawataru commented 7 years ago

Hmm, could you run the following command on g2 and see the output?

docker exec -it g2 bash /root/shared_volume/start_goplane.sh

kak2zz commented 7 years ago
docker exec -it g3 bash /root/shared_volume/start_goplane.sh
docker exec -it g2 bash /root/shared_volume/start_goplane.sh

Log from g2:

:~# less /tmp/goplane/g2/goplane.log
>][labels:[20]]" Length=1 Topic=Table
time="2017-02-06T13:01:33Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:01:35Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:02:42Z" level=debug msg="mac: 3e:50:cb:38:97:0c, ip: <nil>, index: 110, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:02:42Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Topic=Table
time="2017-02-06T13:02:42Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:02:42Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:02:42Z" level=debug msg="mac: 0a:55:94:e7:b0:9c, ip: <nil>, index: 125, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:02:42Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Topic=Table
time="2017-02-06T13:02:42Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:02:42Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:03:42Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:03:44Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:05:51Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:05:53Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:08:00Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:08:02Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:10:09Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:10:11Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:11:59Z" level=debug msg="mac: 0a:55:94:e7:b0:9c, ip: <nil>, index: 125, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:11:59Z" level=debug msg="mac: 3e:50:cb:38:97:0c, ip: <nil>, index: 110, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:11:59Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:11:59Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Length=1 Topic=Table
time="2017-02-06T13:11:59Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:11:59Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Length=1 Topic=Table
time="2017-02-06T13:12:19Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:12:20Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:14:28Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:14:29Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:15:30Z" level=debug msg="mac: 3e:50:cb:38:97:0c, ip: <nil>, index: 110, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:15:30Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Topic=Table
time="2017-02-06T13:15:30Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:15:30Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:15:30Z" level=debug msg="mac: 0a:55:94:e7:b0:9c, ip: <nil>, index: 125, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:15:30Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Topic=Table
time="2017-02-06T13:15:30Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:15:30Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:16:37Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:16:39Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:18:46Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:18:48Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:20:31Z" level=debug msg="mac: 0a:55:94:e7:b0:9c, ip: <nil>, index: 125, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:20:31Z" level=debug msg="mac: 3e:50:cb:38:97:0c, ip: <nil>, index: 110, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:20:31Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:20:31Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:0a:55:94:e7:b0:9c][ip:<nil>][labels:[20]]" Length=1 Topic=Table
time="2017-02-06T13:20:31Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:20:31Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:3e:50:cb:38:97:0c][ip:<nil>][labels:[10]]" Length=1 Topic=Table
time="2017-02-06T13:20:55Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.4:179: i/o timeout" Key=192.168.10.4 Topic=Peer
time="2017-02-06T13:20:57Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer

Log from g3:

:~# less /tmp/goplane/g3/goplane.log
time="2017-02-06T13:02:14Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:02:41Z" level=debug msg="mac: 8e:40:e1:bc:dc:41, ip: <nil>, index: 115, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:02:41Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Topic=Table
time="2017-02-06T13:02:41Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:02:41Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:02:43Z" level=debug msg="mac: 2a:17:00:57:3b:73, ip: <nil>, index: 130, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:02:43Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Topic=Table
time="2017-02-06T13:02:43Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:02:43Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:04:20Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:04:23Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:06:29Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:06:32Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:08:38Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:08:41Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:10:47Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:10:50Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:11:59Z" level=debug msg="mac: 8e:40:e1:bc:dc:41, ip: <nil>, index: 115, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:11:59Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:11:59Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Length=1 Topic=Table
time="2017-02-06T13:12:01Z" level=debug msg="mac: 2a:17:00:57:3b:73, ip: <nil>, index: 130, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:12:01Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:12:01Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Length=1 Topic=Table
time="2017-02-06T13:12:56Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:12:59Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:15:05Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:15:08Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:15:29Z" level=debug msg="mac: 8e:40:e1:bc:dc:41, ip: <nil>, index: 115, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:15:29Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Topic=Table
time="2017-02-06T13:15:29Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:15:29Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:15:31Z" level=debug msg="mac: 2a:17:00:57:3b:73, ip: <nil>, index: 130, family: NDA_VNI, state: NUD_REACHABLE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:15:31Z" level=debug msg="create Destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Topic=Table
time="2017-02-06T13:15:31Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:15:31Z" level=debug msg="computeKnownBestPath known pathlist: 1" Topic=Table
time="2017-02-06T13:17:14Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:17:17Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:19:23Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:19:26Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:20:31Z" level=debug msg="mac: 8e:40:e1:bc:dc:41, ip: <nil>, index: 115, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=10 Topic=VirtualNetwork
time="2017-02-06T13:20:31Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Topic=table
time="2017-02-06T13:20:31Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:10][esi:single-homed][etag:10][mac:8e:40:e1:bc:dc:41][ip:<nil>][labels:[10]]" Length=1 Topic=Table
time="2017-02-06T13:20:33Z" level=debug msg="mac: 2a:17:00:57:3b:73, ip: <nil>, index: 130, family: NDA_VNI, state: NUD_STALE, type: RTM_TYPE(0), flags: NTF_TYPE(0)" Etag=20 Topic=VirtualNetwork
time="2017-02-06T13:20:33Z" level=debug msg="Processing destination" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Topic=table
time="2017-02-06T13:20:33Z" level=debug msg="Removing withdrawals" Key="[type:macadv][rd:65000:20][esi:single-homed][etag:20][mac:2a:17:00:57:3b:73][ip:<nil>][labels:[20]]" Length=1 Topic=Table
time="2017-02-06T13:21:32Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:21:35Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer
time="2017-02-06T13:23:41Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.3:179: i/o timeout" Key=192.168.10.3 Topic=Peer
time="2017-02-06T13:23:44Z" level=debug msg="failed to connect: dial tcp 0.0.0.0:0->192.168.10.2:179: i/o timeout" Key=192.168.10.2 Topic=Peer

But the BGP sessions not established:

:~# docker exec -it g1 gobgp neighbor
Peer            AS Up/Down State       |#Advertised Received Accepted
192.168.10.3 65000   never Active      |          0        0        0
192.168.10.4 65000   never Active      |          0        0        0

:~# docker exec -it g2 gobgp neighbor
Peer            AS Up/Down State       |#Advertised Received Accepted
192.168.10.2 65000   never Active      |          0        0        0
192.168.10.4 65000   never Active      |          0        0        0

:~# docker exec -it g3 gobgp neighbor
Peer            AS Up/Down State       |#Advertised Received Accepted
192.168.10.2 65000   never Active      |          0        0        0
192.168.10.3 65000   never Active      |          0        0        0

A little bit later i'm to try rebuild goplane. Apparently i done something wrong :(

ishidawataru commented 7 years ago

@kak2zz Could you check you can ping from g2 to 192.168.10.2 (which is assigned to g1 )? If it fails (and I think it would), please confirm nothing is disturbing the IP reachability among g1, g2 and g3. You can use ip a, ip r, iptables -L, iptables -L -t nat etc.. to debug the issue.

kak2zz commented 7 years ago

@ishidawataru Unfortunately I have removed the test virtual machine. But when i to trying rebuild goplane docker image, i receive netxt error:

[INFO]  --> Setting version for github.com/spf13/pflag to 01665e1eb3d0533dca0e5acffdff9eec1fcb886f.
[INFO]  --> Setting version for github.com/vishvananda/netns to 8ba1072b58e0c2a240eb5f6120165c7776c3e7b8.
[ERROR] Failed to set version on github.com/vishvananda/netlink to ec395761439a84ca2b7ae00f7a05d429c08b864a: Unable to update checked out version
[INFO]  --> Setting version for golang.org/x/crypto to c197bcf24cde29d3f73c7b4ac6fd41f4384e8af6.
[INFO]  --> Setting version for golang.org/x/sys to a646d33e2ee3172a661fc09bca23bb4889a41bc8.
[INFO]  --> Setting version for golang.org/x/net to 07b51741c1d6423d4a6abab1c49940ec09cb1aaf.
[INFO]  --> Setting version for golang.org/x/text to d69c40b4be55797923cec7457fac7a244d91a9b6.
[INFO]  --> Setting version for google.golang.org/grpc to c2781963b3af261a37e0f14fdcb7c1fa13259e1f.
[INFO]  --> Setting version for gopkg.in/yaml.v2 to e4d366fc3c7938e2958e662b4258c7a89e1f0e3e.
[INFO]  --> Setting version for gopkg.in/tomb.v2 to 14b3d72120e8d10ea6e6b7f87f7175734b1faab8.
[ERROR] Failed to set references: Unable to update checked out version (Skip to cleanup)
The command '/bin/sh -c cd $GOPATH/src/github.com/osrg/goplane && glide install' returned a non-zero code: 1
ishidawataru commented 7 years ago

Sorry for the delay, I updated glide.yaml and test scripts. Please try the latest master.

kak2zz commented 7 years ago

@ishidawataru now test works fine. Thanks!

ishidawataru commented 7 years ago

@kak2zz Thanks for checking!