search

iotaledger / hornet

HORNET is a powerful IOTA fullnode software
Apache License 2.0
309 stars 151 forks source link

neighbors vanish and can't be added again due to stale in-flight state #126

Closed adriankirchner closed 4 years ago

adriankirchner commented 4 years ago

Describe the bug This bug was observed today on 4 hornet instances. All instances are neighbors to each other. Furthermore all instances were neighbors to tcp://auto01.manapotion.io:15601 and tcp://auto02.manapotion.io:15602. After more than 11 hours of regular operation (monitoring shows a constant neighbor count of 5 on all instances) the manapotion instances experienced some congestion resulting in hornet constantly trying to reconnect. After around 38 minutes hornet gave up and never tried to reconnect again. This maybe already a bug, I'm not familiar enough with the hornet internals to judge. After 7 hours while missing these two neighbors I attempted to add tcp://auto01.manapotion.io:15601 again:

$ curl http://localhost:14265 \
-X POST \
-H 'Content-Type: application/json' \
-H 'X-IOTA-API-Version: 1' \
-d '{"command": "addNeighbors","uris": ["tcp://auto01.manapotion.io:15601"]}'

>>> {"addedNeighbors":0,"duration":0}

Neighbor wasn't added so I checked the journal:

WebAPI: Can't add neighbor auto01.manapotion.io:15601, Error: auto01.manapotion.io:15601 is already known and in-flight via 159.69.9.6:15601: neighbor is already known

I expected a stale data situation somewhere in hornet so I tried to remove that neighbor first:

$ curl http://localhost:14265 \
> -X POST \
> -H 'Content-Type: application/json' \
> -H 'X-IOTA-API-Version: 1' \
> -d '{"command": "removeNeighbors", "uris": ["tcp://auto01.manapotion.io:15601"]}'

>>> {"removedNeighbors":0,"duration":0}

Neighbor wasn't removed and the journal has no entry about that operation. I also tried different uri notations:

Furthermore the getNeighbors-API-Call doesn't list these two manapotion instances.

Both hostnames auto01.manapotion.io and auto02.manapotion.io resolve to the ip address 159.69.9.6 and only differ in port. I could image a bug in origin address parsing or identity building. But maybe this is race condition in pool handling only.

To Reproduce See bug description

Expected behavior At first I would expect hornet to try to reconnect after a certain grace period. At second I would expect to be able to remove and add the neighbor in question again.

Environment information:

Additional context

Here is the journal excerpt (congestion starting at 14:48 and reconnecting stops at 15:25), the config.json and the neighbor.json

journalctl --since="2020-01-06 03:38:50" -o short-precise -u hornet | grep -E "(manapotion.io|159.69.9.6)"

Jan 06 03:38:50.833089 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 03:38:50.880434 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 03:38:50.893739 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 03:38:50.895362 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 03:38:50.895362 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 03:38:50.896078 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 03:38:50.896331 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 03:38:50.896331 hornet-1 hornet[21039]: 2020/01/06 03:38:50 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:48:21.862746 hornet-1 hornet[21039]: 2020/01/06 14:48:21 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: read tcp [REDACTED]:45370->159.69.9.6:15601: read: connection reset by peer
Jan 06 14:48:21.865181 hornet-1 hornet[21039]: 2020/01/06 14:48:21 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:48:21.866804 hornet-1 hornet[21039]: 2020/01/06 14:48:21 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:48:51.531293 hornet-1 hornet[21039]: 2020/01/06 14:48:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:48:51.538109 hornet-1 hornet[21039]: 2020/01/06 14:48:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 14:48:51.538510 hornet-1 hornet[21039]: 2020/01/06 14:48:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:49:07.237592 hornet-1 hornet[21039]: 2020/01/06 14:49:07 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: read tcp [REDACTED]:37632->159.69.9.6:15602: read: connection reset by peer
Jan 06 14:49:07.239080 hornet-1 hornet[21039]: 2020/01/06 14:49:07 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:49:07.239466 hornet-1 hornet[21039]: 2020/01/06 14:49:07 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:49:51.575893 hornet-1 hornet[21039]: 2020/01/06 14:49:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:49:51.580635 hornet-1 hornet[21039]: 2020/01/06 14:49:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 14:49:51.581199 hornet-1 hornet[21039]: 2020/01/06 14:49:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:49:51.581560 hornet-1 hornet[21039]: 2020/01/06 14:49:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:49:51.585166 hornet-1 hornet[21039]: 2020/01/06 14:49:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 14:49:51.585579 hornet-1 hornet[21039]: 2020/01/06 14:49:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:50:51.588826 hornet-1 hornet[21039]: 2020/01/06 14:50:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:50:51.593941 hornet-1 hornet[21039]: 2020/01/06 14:50:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 14:50:51.594450 hornet-1 hornet[21039]: 2020/01/06 14:50:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:50:51.594765 hornet-1 hornet[21039]: 2020/01/06 14:50:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:50:51.598225 hornet-1 hornet[21039]: 2020/01/06 14:50:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 14:50:51.598618 hornet-1 hornet[21039]: 2020/01/06 14:50:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:51:51.600747 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:51:51.605354 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:51:51.608478 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 14:51:51.608694 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:51:51.610349 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:51:51.611154 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:51:51.611335 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:51:51.612890 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:51:51.613160 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:51:51.613337 hornet-1 hornet[21039]: 2020/01/06 14:51:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:52:51.620039 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:52:51.623472 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:52:51.626256 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:52:51.626515 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:52:51.626569 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:52:51.627258 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:52:51.627361 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:52:51.627409 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:52:51.629405 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:52:51.629626 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:52:51.629626 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:52:51.629963 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:52:51.630096 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:52:51.630140 hornet-1 hornet[21039]: 2020/01/06 14:52:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:53:51.627745 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:53:51.653059 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:53:51.654190 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:53:51.654504 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:53:51.654640 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:53:51.657449 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: read tcp [REDACTED]:40208->159.69.9.6:15602: read: connection reset by peer
Jan 06 14:53:51.657665 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:53:51.657822 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:53:51.663092 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:53:51.663373 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:53:51.663509 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:53:51.663661 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:53:51.663856 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:53:51.663984 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:53:51.664179 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:47946->159.69.9.6:15601: use of closed network connection
Jan 06 14:53:51.665507 hornet-1 hornet[21039]: 2020/01/06 14:53:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:47946: use of closed network connection
Jan 06 14:54:51.657102 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:54:51.660313 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:54:51.663409 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:54:51.663651 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:54:51.663762 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:54:51.663856 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:54:51.663985 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:54:51.664092 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:54:51.666490 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:54:51.666675 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:54:51.666765 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:54:51.667630 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:54:51.667795 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:54:51.667909 hornet-1 hornet[21039]: 2020/01/06 14:54:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:55:51.666068 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:55:51.670479 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:55:51.678595 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:55:51.678862 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:55:51.678979 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:55:51.679077 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:55:51.679204 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:55:51.679298 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:55:51.679438 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:47960->159.69.9.6:15601: use of closed network connection
Jan 06 14:55:51.679634 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:47960: use of closed network connection
Jan 06 14:55:51.681856 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:55:51.682061 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:55:51.682161 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:55:51.682261 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:55:51.682392 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:55:51.682482 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:55:51.682607 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: close tcp [REDACTED]:40226->159.69.9.6:15602: use of closed network connection
Jan 06 14:55:51.682795 hornet-1 hornet[21039]: 2020/01/06 14:55:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15602: failed to send packet header: couldn't send: set tcp [REDACTED]:40226: use of closed network connection
Jan 06 14:56:51.674441 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:56:51.677698 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:56:51.681155 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:56:51.681369 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:56:51.681478 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:56:51.681985 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:56:51.681985 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:56:51.681985 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:56:51.681985 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:47966->159.69.9.6:15601: use of closed network connection
Jan 06 14:56:51.681985 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:47966: use of closed network connection
Jan 06 14:56:51.684820 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:56:51.685394 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:56:51.685394 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:56:51.685394 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:56:51.685394 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:56:51.685394 hornet-1 hornet[21039]: 2020/01/06 14:56:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:57:51.692583 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:57:51.695519 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:57:51.698342 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:57:51.698571 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:57:51.698571 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:57:51.722131 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:57:51.722337 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:57:51.722440 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:57:51.734942 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:57:51.735174 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:57:51.735228 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:57:51.758577 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:57:51.758577 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: close tcp [REDACTED]:40240->159.69.9.6:15602: use of closed network connection
Jan 06 14:57:51.758971 hornet-1 hornet[21039]: SendState error: failed to send packet header: couldn't send: write tcp [REDACTED]:40240->159.69.9.6:15602: write: broken pipe
Jan 06 14:57:51.758971 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15602: failed to send packet header: couldn't send: write tcp [REDACTED]:40240->159.69.9.6:15602: write: broken pipe
Jan 06 14:57:51.759233 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:57:51.759233 hornet-1 hornet[21039]: 2020/01/06 14:57:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:58:51.735545 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:58:51.738623 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:58:51.747277 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:58:51.747406 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:58:51.747406 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:58:51.747406 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:58:51.747509 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:58:51.747509 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:58:51.751276 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:58:51.751358 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:58:51.751358 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:58:51.751708 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:58:51.751762 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:58:51.751762 hornet-1 hornet[21039]: 2020/01/06 14:58:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 14:59:51.748486 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 14:59:51.751754 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 14:59:51.757737 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 14:59:51.757925 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 14:59:51.757925 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 14:59:51.758008 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 14:59:51.758078 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 14:59:51.758078 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 14:59:51.759051 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 14:59:51.759148 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 14:59:51.759148 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 14:59:51.759928 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 14:59:51.760041 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 14:59:51.760461 hornet-1 hornet[21039]: 2020/01/06 14:59:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:00:51.755304 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:00:51.758334 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:00:51.762193 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:00:51.762335 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:00:51.762335 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:00:51.762471 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:00:51.762570 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:00:51.762570 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:00:51.765520 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:00:51.765639 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:00:51.765639 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:00:51.765704 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:00:51.765800 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:00:51.765847 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:00:51.766877 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48048->159.69.9.6:15601: use of closed network connection
Jan 06 15:00:51.767336 hornet-1 hornet[21039]: 2020/01/06 15:00:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48048: use of closed network connection
Jan 06 15:01:51.762717 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:01:51.769923 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:01:51.771044 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:01:51.771264 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:01:51.771373 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:01:51.773970 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:01:51.774187 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:01:51.774340 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:01:51.776591 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:01:51.776782 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:01:51.776887 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:01:51.777009 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:01:51.777172 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:01:51.777296 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:01:51.777436 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48056->159.69.9.6:15601: use of closed network connection
Jan 06 15:01:51.777690 hornet-1 hornet[21039]: 2020/01/06 15:01:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48056: use of closed network connection
Jan 06 15:02:51.773913 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:02:51.777281 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:02:51.788710 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:02:51.788833 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:02:51.788833 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:02:51.788833 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:02:51.789407 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:02:51.789407 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:02:51.789407 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:02:51.789407 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:02:51.789407 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:02:51.807505 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:02:51.807669 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:02:51.807669 hornet-1 hornet[21039]: 2020/01/06 15:02:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:03:51.789827 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:03:51.793232 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:03:51.796605 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:03:51.796841 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:03:51.796959 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:03:51.798156 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:03:51.798337 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:03:51.798557 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:03:51.799448 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:03:51.799613 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:03:51.799705 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:03:51.800246 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:03:51.800246 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:03:51.800246 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:03:51.800246 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48070->159.69.9.6:15601: use of closed network connection
Jan 06 15:03:51.800246 hornet-1 hornet[21039]: 2020/01/06 15:03:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48070: use of closed network connection
Jan 06 15:04:51.798078 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:04:51.801806 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:04:51.804824 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:04:51.805600 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:04:51.806031 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:04:51.806338 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:04:51.806733 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:04:51.806998 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:04:51.807342 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48074->159.69.9.6:15601: use of closed network connection
Jan 06 15:04:51.808048 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48074: use of closed network connection
Jan 06 15:04:51.808742 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:04:51.809565 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:04:51.809565 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:04:51.811855 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:04:51.812305 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:04:51.812606 hornet-1 hornet[21039]: 2020/01/06 15:04:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:05:51.809455 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:05:51.813170 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:05:51.816540 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:05:51.816957 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:05:51.817205 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:05:51.817379 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:05:51.817604 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:05:51.817800 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:05:51.819398 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:05:51.819672 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:05:51.819831 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:05:51.819993 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:05:51.820192 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:05:51.820364 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:05:51.820583 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: close tcp [REDACTED]:40350->159.69.9.6:15602: use of closed network connection
Jan 06 15:05:51.820931 hornet-1 hornet[21039]: 2020/01/06 15:05:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15602: failed to send packet header: couldn't send: set tcp [REDACTED]:40350: use of closed network connection
Jan 06 15:06:51.817868 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:06:51.821238 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:06:51.824796 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:06:51.825265 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:06:51.825319 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:06:51.825349 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:06:51.825469 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:06:51.825516 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:06:51.825597 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48090->159.69.9.6:15601: use of closed network connection
Jan 06 15:06:51.825668 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48090: use of closed network connection
Jan 06 15:06:51.827314 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:06:51.827523 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:06:51.827558 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:06:51.827558 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:06:51.827707 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:06:51.827747 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:06:51.827794 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: close tcp [REDACTED]:40356->159.69.9.6:15602: use of closed network connection
Jan 06 15:06:51.827872 hornet-1 hornet[21039]: 2020/01/06 15:06:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15602: failed to send packet header: couldn't send: set tcp [REDACTED]:40356: use of closed network connection
Jan 06 15:07:51.825912 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:07:51.829334 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:07:51.832654 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:07:51.833018 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:07:51.833104 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:07:51.833260 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:07:51.833452 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:07:51.833532 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:07:51.833677 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48116->159.69.9.6:15601: use of closed network connection
Jan 06 15:07:51.833924 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48116: use of closed network connection
Jan 06 15:07:51.835525 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:07:51.835737 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:07:51.835778 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:07:51.836234 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:07:51.836438 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:07:51.836540 hornet-1 hornet[21039]: 2020/01/06 15:07:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:08:51.833025 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:08:51.836159 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:08:51.839049 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:08:51.839287 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:08:51.839393 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:08:51.839500 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:08:51.839628 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:08:51.839724 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:08:51.839848 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48126->159.69.9.6:15601: use of closed network connection
Jan 06 15:08:51.840038 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48126: use of closed network connection
Jan 06 15:08:51.842133 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:08:51.842735 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:08:51.842735 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:08:51.843461 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:08:51.843623 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:08:51.843729 hornet-1 hornet[21039]: 2020/01/06 15:08:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:09:51.840994 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:09:51.844076 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:09:51.846977 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:09:51.847114 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:09:51.847161 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:09:51.847296 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:09:51.847397 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:09:51.847451 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:09:51.849797 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:09:51.849927 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:09:51.849986 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:09:51.850049 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:09:51.850139 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:09:51.850199 hornet-1 hornet[21039]: 2020/01/06 15:09:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:10:51.848240 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:10:51.852224 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:10:51.856018 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:10:51.856426 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:10:51.856622 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:10:51.856893 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:10:51.857345 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:10:51.857600 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:10:51.858026 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48142->159.69.9.6:15601: use of closed network connection
Jan 06 15:10:51.858609 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48142: use of closed network connection
Jan 06 15:10:51.859308 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:10:51.859713 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:10:51.859981 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:10:51.860238 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:10:51.860566 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:10:51.860813 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:10:51.861101 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: close tcp [REDACTED]:40408->159.69.9.6:15602: use of closed network connection
Jan 06 15:10:51.861672 hornet-1 hornet[21039]: 2020/01/06 15:10:51 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15602: failed to send packet header: couldn't send: set tcp [REDACTED]:40408: use of closed network connection
Jan 06 15:11:51.858045 hornet-1 hornet[21039]: 2020/01/06 15:11:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:11:51.862164 hornet-1 hornet[21039]: 2020/01/06 15:11:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:11:51.862594 hornet-1 hornet[21039]: 2020/01/06 15:11:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:11:51.862868 hornet-1 hornet[21039]: 2020/01/06 15:11:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:11:51.866312 hornet-1 hornet[21039]: 2020/01/06 15:11:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:11:51.866934 hornet-1 hornet[21039]: 2020/01/06 15:11:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:12:51.870462 hornet-1 hornet[21039]: 2020/01/06 15:12:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:12:51.874933 hornet-1 hornet[21039]: 2020/01/06 15:12:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:12:51.875457 hornet-1 hornet[21039]: 2020/01/06 15:12:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:12:51.875783 hornet-1 hornet[21039]: 2020/01/06 15:12:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:12:51.879565 hornet-1 hornet[21039]: 2020/01/06 15:12:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:12:51.880011 hornet-1 hornet[21039]: 2020/01/06 15:12:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:13:51.882214 hornet-1 hornet[21039]: 2020/01/06 15:13:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:13:51.886844 hornet-1 hornet[21039]: 2020/01/06 15:13:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:13:51.886938 hornet-1 hornet[21039]: 2020/01/06 15:13:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:13:51.886938 hornet-1 hornet[21039]: 2020/01/06 15:13:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:13:51.890498 hornet-1 hornet[21039]: 2020/01/06 15:13:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:13:51.890498 hornet-1 hornet[21039]: 2020/01/06 15:13:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:14:51.893386 hornet-1 hornet[21039]: 2020/01/06 15:14:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:14:51.898118 hornet-1 hornet[21039]: 2020/01/06 15:14:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:14:51.898673 hornet-1 hornet[21039]: 2020/01/06 15:14:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:14:51.899125 hornet-1 hornet[21039]: 2020/01/06 15:14:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:14:51.902449 hornet-1 hornet[21039]: 2020/01/06 15:14:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:14:51.902854 hornet-1 hornet[21039]: 2020/01/06 15:14:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:15:51.906233 hornet-1 hornet[21039]: 2020/01/06 15:15:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:15:51.911136 hornet-1 hornet[21039]: 2020/01/06 15:15:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:15:51.911623 hornet-1 hornet[21039]: 2020/01/06 15:15:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:15:51.918157 hornet-1 hornet[21039]: 2020/01/06 15:15:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:15:51.921569 hornet-1 hornet[21039]: 2020/01/06 15:15:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:15:51.921962 hornet-1 hornet[21039]: 2020/01/06 15:15:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:16:51.925438 hornet-1 hornet[21039]: 2020/01/06 15:16:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:16:51.929929 hornet-1 hornet[21039]: 2020/01/06 15:16:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:16:51.930395 hornet-1 hornet[21039]: 2020/01/06 15:16:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:16:51.930757 hornet-1 hornet[21039]: 2020/01/06 15:16:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:16:51.934170 hornet-1 hornet[21039]: 2020/01/06 15:16:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:16:51.934588 hornet-1 hornet[21039]: 2020/01/06 15:16:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:17:51.937509 hornet-1 hornet[21039]: 2020/01/06 15:17:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:17:51.941850 hornet-1 hornet[21039]: 2020/01/06 15:17:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:17:51.942336 hornet-1 hornet[21039]: 2020/01/06 15:17:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:17:51.942691 hornet-1 hornet[21039]: 2020/01/06 15:17:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:17:51.946171 hornet-1 hornet[21039]: 2020/01/06 15:17:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:17:51.946554 hornet-1 hornet[21039]: 2020/01/06 15:17:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:18:51.984469 hornet-1 hornet[21039]: 2020/01/06 15:18:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:18:51.988479 hornet-1 hornet[21039]: 2020/01/06 15:18:51 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:18:51.988479 hornet-1 hornet[21039]: 2020/01/06 15:18:51 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:18:51.988479 hornet-1 hornet[21039]: 2020/01/06 15:18:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:18:51.991381 hornet-1 hornet[21039]: 2020/01/06 15:18:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:18:51.991613 hornet-1 hornet[21039]: 2020/01/06 15:18:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:19:51.995014 hornet-1 hornet[21039]: 2020/01/06 15:19:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:19:51.999108 hornet-1 hornet[21039]: 2020/01/06 15:19:51 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:19:51.999566 hornet-1 hornet[21039]: 2020/01/06 15:19:51 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:19:51.999888 hornet-1 hornet[21039]: 2020/01/06 15:19:51 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:19:52.007573 hornet-1 hornet[21039]: 2020/01/06 15:19:52 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:19:52.008000 hornet-1 hornet[21039]: 2020/01/06 15:19:52 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:20:52.011397 hornet-1 hornet[21039]: 2020/01/06 15:20:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:20:52.016577 hornet-1 hornet[21039]: 2020/01/06 15:20:52 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:20:52.017094 hornet-1 hornet[21039]: 2020/01/06 15:20:52 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:20:52.017569 hornet-1 hornet[21039]: 2020/01/06 15:20:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:20:52.021089 hornet-1 hornet[21039]: 2020/01/06 15:20:52 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:20:52.021592 hornet-1 hornet[21039]: 2020/01/06 15:20:52 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:21:52.024998 hornet-1 hornet[21039]: 2020/01/06 15:21:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:21:52.028560 hornet-1 hornet[21039]: 2020/01/06 15:21:52 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:21:52.028794 hornet-1 hornet[21039]: 2020/01/06 15:21:52 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:21:52.028995 hornet-1 hornet[21039]: 2020/01/06 15:21:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:21:52.032260 hornet-1 hornet[21039]: 2020/01/06 15:21:52 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:21:52.032320 hornet-1 hornet[21039]: 2020/01/06 15:21:52 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:22:52.035144 hornet-1 hornet[21039]: 2020/01/06 15:22:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:22:52.039344 hornet-1 hornet[21039]: 2020/01/06 15:22:52 [ ERROR ] Gossip: connection attempt to auto01.manapotion.io:15601 failed: error when connecting to neighbor 159.69.9.6:15601: could not connect to neighbor: dial tcp 159.69.9.6:15601: connect: connection refused
Jan 06 15:22:52.039793 hornet-1 hornet[21039]: 2020/01/06 15:22:52 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:22:52.040175 hornet-1 hornet[21039]: 2020/01/06 15:22:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:22:52.045292 hornet-1 hornet[21039]: 2020/01/06 15:22:52 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:22:52.045705 hornet-1 hornet[21039]: 2020/01/06 15:22:52 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:23:52.048490 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:23:52.052582 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:23:52.055529 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15601) ...
Jan 06 15:23:52.056343 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: neighbor auto01.manapotion.io:15601 is now connected
Jan 06 15:23:52.056680 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: neighbor handshaked auto01.manapotion.io:15601, using protocol version 2
Jan 06 15:23:52.057045 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:23:52.057505 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:23:52.057715 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: added neighbor auto01.manapotion.io:15601 back into reconnect pool...
Jan 06 15:23:52.058081 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: close tcp [REDACTED]:48238->159.69.9.6:15601: use of closed network connection
Jan 06 15:23:52.058549 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ ERROR ] Gossip: protocol error on neighbor 159.69.9.6:15601: failed to send packet header: couldn't send: set tcp [REDACTED]:48238: use of closed network connection
Jan 06 15:23:52.059069 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ ERROR ] Gossip: connection attempt to auto02.manapotion.io:15602 failed: error when connecting to neighbor 159.69.9.6:15602: could not connect to neighbor: dial tcp 159.69.9.6:15602: connect: connection refused
Jan 06 15:23:52.059275 hornet-1 hornet[21039]: 2020/01/06 15:23:52 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:24:52.062565 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto01.manapotion.io:15601
Jan 06 15:24:52.067243 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:24:52.069956 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15601: EOF
Jan 06 15:24:52.070645 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: connection closed to 159.69.9.6:15601
Jan 06 15:24:52.073864 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: Starting Gossip Send Queue Dispatcher (159.69.9.6:15602) ...
Jan 06 15:24:52.074574 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: neighbor auto02.manapotion.io:15602 is now connected
Jan 06 15:24:52.074935 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: neighbor handshaked auto02.manapotion.io:15602, using protocol version 2
Jan 06 15:24:52.075266 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:24:52.075929 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 15:24:52.076388 hornet-1 hornet[21039]: 2020/01/06 15:24:52 [ INFO ] Gossip: added neighbor auto02.manapotion.io:15602 back into reconnect pool...
Jan 06 15:25:52.072524 hornet-1 hornet[21039]: 2020/01/06 15:25:52 [ INFO ] Gossip: connecting and initiating handshake for neighbor auto02.manapotion.io:15602
Jan 06 15:25:52.079250 hornet-1 hornet[21039]: 2020/01/06 15:25:52 [ ERROR ] Gossip: connection error on neighbor 159.69.9.6:15602: EOF
Jan 06 15:25:52.079626 hornet-1 hornet[21039]: 2020/01/06 15:25:52 [ INFO ] Gossip: connection closed to 159.69.9.6:15602
Jan 06 22:33:24.638164 hornet-1 hornet[21039]: 2020/01/06 22:33:24 [ WARNING ] WebAPI: Can't add neighbor auto01.manapotion.io:15601, Error: auto01.manapotion.io:15601 is already known and in-flight via 159.69.9.6:15601: neighbor is already known
Jan 06 22:38:01.401390 hornet-1 hornet[21039]: 2020/01/06 22:38:01 [ WARNING ] WebAPI: Can't add neighbor auto01.manapotion.io:15601, Error: auto01.manapotion.io:15601 is already known and in-flight via 159.69.9.6:15601: neighbor is already known

config.json

{
    "api": {
        "auth": {
            "password": "",
            "username": ""
        },
        "host": "0.0.0.0",
        "maxbodylength": 1000000,
        "maxfindtransactions": 100000,
        "maxgettrytes": 1000,
        "maxrequestslist": 1000,
        "permitRemoteAccess": [
            "getNodeInfo",
            "getBalances",
            "checkConsistency",
            "getTransactionsToApprove",
            "getInclusionStates",
            "getNodeAPIConfiguration",
            "wereAddressesSpentFrom",
            "broadcastTransactions",
            "findTransactions",
            "storeTransactions",
            "getTrytes"
        ],
        "port": 14265,
        "remoteauth": ""
    },
    "compass": {
        "loadLSMIAsLMI": false
    },
    "dashboard": {
        "basic_auth": {
            "enabled": false,
            "password": "hornet",
            "username": "hornet"
        },
        "dev": false,
        "host": "127.0.0.1",
        "port": 8081
    },
    "db": {
        "path": "/mnt/mainnet/mainnetdb"
    },
    "localsnapshots": {
        "path": "/mnt/mainnet/2019-12-26_113404_UTC-export.gz.bin"
    },
    "milestones": {
        "coordinator": "EQSAUZXULTTYZCLNJNTXQTQHOMOFZERHTCGTXOLTVAHKSA9OGAZDEKECURBRIXIJWNPFCQIOVFVVXJVD9",
        "coordinatorsecuritylevel": 2,
        "numberofkeysinamilestone": 23
    },
    "monitor": {
        "apiPort": 4433,
        "domain": "",
        "host": "127.0.0.1",
        "port": 4434,
        "tanglemonitorpath": "tanglemonitor/frontend"
    },
    "network": {
        "address": "0.0.0.0",
        "port": 15600,
        "preferIPv6": false,
        "reconnectattemptintervalseconds": 60
    },
    "node": {
        "disableplugins": [

        ],
        "enableplugins": [

        ],
        "loglevel": 127
    },
    "profiles": {
        "custom": {
            "badger": {
                "ZSTDCompressionLevel": 10,
                "blockSize": 4096,
                "bloomFalsePositive": 0.01,
                "compactLevel0OnClose": false,
                "eventLogging": false,
                "keepL0InMemory": false,
                "levelOneSize": 268435456,
                "levelSizeMultiplier": 10,
                "logRotatesToFlush": 2,
                "maxCacheSize": 50000000,
                "maxLevels": 7,
                "maxTableSize": 67108864,
                "numCompactors": 2,
                "numLevelZeroTables": 5,
                "numLevelZeroTablesStall": 10,
                "numMemtables": 5,
                "numVersionsToKeep": 1,
                "syncWrites": false,
                "tableLoadingMode": 2,
                "valueLogFileSize": 1073741823,
                "valueLogLoadingMode": 2,
                "valueLogMaxEntries": 1000000,
                "valueThreshold": 32,
                "verifyValueChecksum": false,
                "withTruncate": false
            },
            "caches": {
                "approvers": {
                    "evictionSize": 1000,
                    "size": 100000
                },
                "bundles": {
                    "evictionSize": 1000,
                    "size": 20000
                },
                "incomingTransactionFilter": {
                    "size": 5000
                },
                "milestones": {
                    "evictionSize": 100,
                    "size": 1000
                },
                "refsInvalidBundle": {
                    "size": 10000
                },
                "requestQueue": {
                    "size": 100000
                },
                "spentAddresses": {
                    "evictionSize": 1000,
                    "size": 5000
                },
                "transactions": {
                    "evictionSize": 1000,
                    "size": 50000
                }
            }
        }
    },
    "protocol": {
        "mwm": 14
    },
    "spammer": {
        "address": "HORNET99INTEGRATED99SPAMMER999999999999999999999999999999999999999999999999999999",
        "depth": 3,
        "message": "Spamming with HORNET tipselect",
        "tag": "HORNET99INTEGRATED99SPAMMER",
        "tpsratelimit": 0.1,
        "workers": 1
    },
    "tipsel": {
        "belowmaxdepthtransactionlimit": 20000,
        "maxdepth": 15
    },
    "useProfile": "2gb",
    "zmq": {
        "host": "127.0.0.1",
        "port": 5556
    }
}

neighbors.json

{
    "autotetheringenabled": false,
    "maxneighbors": 8,
    "neighbors": [
        {
            "identity": "[REDACTED]:15600",
            "preferIPv6": false
        },
        {
            "identity": "[REDACTED]:15600",
            "preferIPv6": false
        },
        {
            "identity": "[REDACTED]:15600",
            "preferIPv6": false
        },
        {
            "identity": "auto01.manapotion.io:15601",
            "preferIPv6": false
        },
        {
            "identity": "auto02.manapotion.io:15602",
            "preferIPv6": false
        }
    ]
}
muXxer commented 4 years ago

Damn, that's how a bugreport should look like! Thank you, we will investigate!

muXxer commented 4 years ago

Should be fixed with #282 Can you please try again with the latest dev branch @adriankirchner

adriankirchner commented 4 years ago

If I recall correctly I've never experienced this problem with 0.3.0 running for weeks now. I will report if I see this behaviour in the upcoming 0.4.0.

Thanks!