helium / gateway-rs

The Helium Gateway
Apache License 2.0
280 stars 110 forks source link

Gateway region stream error #210

Closed skiplyfrance closed 2 years ago

skiplyfrance commented 2 years ago

Hi, I installed v23, and I have following errors:

2022-03-04T08:06:26.313304+01:00 mtcdt helium_gateway[2019]: gateway region stream error: Service(Rpc(Status { code: Unknown, source: None })), module: dispatcher
2022-03-04T08:06:26.321018+01:00 mtcdt helium_gateway[2019]: selecting new gateway in 19s, module: dispatcher
2022-03-04T08:06:45.721111+01:00 mtcdt helium_gateway[2019]: using gateway, module: dispatcher, uri: http://54.251.77.229:8080/, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:06:46.866966+01:00 mtcdt helium_gateway[2019]: checking gateway, module: dispatcher, block_age: 93, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:06:47.208019+01:00 mtcdt helium_gateway[2019]: starting, oui: 20, uri: http://43.154.117.143:8080/, pubkey: 11Z71QiBvLd8m2LFtgDpVwR86H3mpXsT93wbntF46LUsSxyqxCw, module: router
2022-03-04T08:06:47.399191+01:00 mtcdt helium_gateway[2019]: starting, oui: 19, uri: http://44.234.246.239:8080/, pubkey: 11HvwA1pKjzhDF9BvDDwopeNLrb3it6sNVXrtkq2DAdakVWvKSD, module: router
2022-03-04T08:06:47.592007+01:00 mtcdt helium_gateway[2019]: starting, oui: 16, uri: http://13.37.13.24:8080/, pubkey: 11afuQSrmk52mgxLu91AdtDXbJ9wmqWBUxC3hvjejoXkxEZfPvY, module: router
2022-03-04T08:06:47.779312+01:00 mtcdt helium_gateway[2019]: starting, oui: 12, uri: http://54.219.236.122:8080/, pubkey: 112ewJNEUfSg3Jvo276tMjzFC2JzmmZcJJ32CWz2fzYqbyCMMTe1, module: router
2022-03-04T08:06:47.968900+01:00 mtcdt helium_gateway[2019]: starting, oui: 10, uri: http://54.228.141.195:8080/, pubkey: 11YmZtwTPEuMSFGxze1x9TfDfGezN7vXevLu71iJe9FBbvNRAgk, module: router
2022-03-04T08:06:48.159087+01:00 mtcdt helium_gateway[2019]: starting, oui: 9, uri: http://44.238.156.97:8080/, pubkey: 11w77YQLhgUt8HUJrMtntGGr97RyXmot1ofs5Ct2ELTmbFoYsQa, module: router
2022-03-04T08:06:48.349812+01:00 mtcdt helium_gateway[2019]: starting, oui: 4, uri: http://54.193.165.228:8080/, pubkey: 11263KvqW3GZPAvag5sQYtBJSjb25azSTSwoi5Tza9kboaLRxcsv, module: router
2022-03-04T08:06:48.553308+01:00 mtcdt helium_gateway[2019]: starting, oui: 2, uri: http://54.176.88.149:8080/, pubkey: 1124CJ9yJaHq4D6ugyPCDnSBzQik61C1BqD9VMh1vsUmjwt16HNB, module: router
2022-03-04T08:06:48.737150+01:00 mtcdt helium_gateway[2019]: updated routing to height 1252255, module: dispatcher
2022-03-04T08:06:48.738188+01:00 mtcdt helium_gateway[2019]: gateway region stream error: Service(Rpc(Status { code: Unknown, source: None })), module: dispatcher
2022-03-04T08:06:48.739231+01:00 mtcdt helium_gateway[2019]: selecting new gateway in 12s, module: dispatcher
2022-03-04T08:06:48.740285+01:00 mtcdt helium_gateway[2019]: starting, oui: 1, uri: http://52.8.80.146:8080/, pubkey: 112qB3YaH5bZkCnKA5uRH7tBtGNv2Y5B4smv1jsmvGUzgKT71QpE, module: router
2022-03-04T08:06:48.741348+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 1, uri: http://52.8.80.146:8080/, pubkey: 112qB3YaH5bZkCnKA5uRH7tBtGNv2Y5B4smv1jsmvGUzgKT71QpE, module: router
2022-03-04T08:06:48.743677+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 19, uri: http://44.234.246.239:8080/, pubkey: 11HvwA1pKjzhDF9BvDDwopeNLrb3it6sNVXrtkq2DAdakVWvKSD, module: router
2022-03-04T08:06:48.756802+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 12, uri: http://54.219.236.122:8080/, pubkey: 112ewJNEUfSg3Jvo276tMjzFC2JzmmZcJJ32CWz2fzYqbyCMMTe1, module: router
2022-03-04T08:06:48.758413+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 20, uri: http://43.154.117.143:8080/, pubkey: 11Z71QiBvLd8m2LFtgDpVwR86H3mpXsT93wbntF46LUsSxyqxCw, module: router
2022-03-04T08:06:48.759506+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 9, uri: http://44.238.156.97:8080/, pubkey: 11w77YQLhgUt8HUJrMtntGGr97RyXmot1ofs5Ct2ELTmbFoYsQa, module: router
2022-03-04T08:06:48.760588+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 16, uri: http://13.37.13.24:8080/, pubkey: 11afuQSrmk52mgxLu91AdtDXbJ9wmqWBUxC3hvjejoXkxEZfPvY, module: router
2022-03-04T08:06:48.761675+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 10, uri: http://54.228.141.195:8080/, pubkey: 11YmZtwTPEuMSFGxze1x9TfDfGezN7vXevLu71iJe9FBbvNRAgk, module: router
2022-03-04T08:06:48.762762+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 4, uri: http://54.193.165.228:8080/, pubkey: 11263KvqW3GZPAvag5sQYtBJSjb25azSTSwoi5Tza9kboaLRxcsv, module: router
2022-03-04T08:06:48.763849+01:00 mtcdt helium_gateway[2019]: gateway changed, shutting down, oui: 2, uri: http://54.176.88.149:8080/, pubkey: 1124CJ9yJaHq4D6ugyPCDnSBzQik61C1BqD9VMh1vsUmjwt16HNB, module: router
2022-03-04T08:07:01.337549+01:00 mtcdt helium_gateway[2019]: using gateway, module: dispatcher, uri: http://54.251.77.229:8080/, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:07:02.061993+01:00 mtcdt helium_gateway[2019]: checking gateway, module: dispatcher, block_age: 108, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:07:02.070588+01:00 mtcdt helium_gateway[2019]: gateway region stream error: Service(Rpc(Status { code: Unknown, source: None })), module: dispatcher
2022-03-04T08:07:02.071640+01:00 mtcdt helium_gateway[2019]: selecting new gateway in 9s, module: dispatcher
2022-03-04T08:07:11.471259+01:00 mtcdt helium_gateway[2019]: using gateway, module: dispatcher, uri: http://54.251.77.229:8080/, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:07:11.842408+01:00 mtcdt helium_gateway[2019]: gateway region stream error: Service(Rpc(Status { code: Unknown, source: None })), module: dispatcher
2022-03-04T08:07:11.850088+01:00 mtcdt helium_gateway[2019]: selecting new gateway in 25s, module: dispatcher
2022-03-04T08:07:36.851015+01:00 mtcdt helium_gateway[2019]: using gateway, module: dispatcher, uri: http://54.251.77.229:8080/, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:07:37.268240+01:00 mtcdt helium_gateway[2019]: gateway region stream error: Service(Rpc(Status { code: Unknown, source: None })), module: dispatcher
2022-03-04T08:07:37.280580+01:00 mtcdt helium_gateway[2019]: selecting new gateway in 29s, module: dispatcher
2022-03-04T08:08:06.881615+01:00 mtcdt helium_gateway[2019]: using gateway, module: dispatcher, uri: http://54.251.77.229:8080/, pubkey: 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW
2022-03-04T08:08:07.248469+01:00 mtcdt helium_gateway[2019]: gateway region stream error: Service(Rpc(Status { code: Unknown, source: None })), module: dispatcher
2022-03-04T08:08:07.260328+01:00 mtcdt helium_gateway[2019]: selecting new gateway in 74s, module: dispatcher
madninja commented 2 years ago

How is this gateway connected to the internet? It looks like it’s losing its connection to the validators

skiplyfrance commented 2 years ago

Ethernet / Optical fiber.

madninja commented 2 years ago

What does your default.toml look like? It appears that it's selecting the same gateway-service twice, which is possible given randomness, but if gateway-service 11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW is having issues your gateway should really end up picking another one from the list that is in default.toml

skiplyfrance commented 2 years ago

default.toml:

## gateway-rs default configuration file
##
## NOTE: Do _NOT_ change values in this file. 
##   Override settings in settings.toml by putting the sections and
##   settings that need to be changed there.  

## Keypair is a string that supports specifying different locations for 
## the secrets. The default one is file based one since all devices 
## can support it.
##
## Override the setting by putting a keypair line in the 
## local settings.toml. Changing things in this file will be overwritten
## by upgrades. 
##
## File: 
keypair = "/etc/helium_gateway/gateway_key.bin"
## ECC608 based
# keypair = "ecc://i2c-1:96&slot=0"
listen = "127.0.0.1:1680"
api = 4467
region = "US915"

[log]
method = "stdio"
level = "info"
timestamp = false

[update]
# Enable update checking
enabled = true
# OVERRIDE: Platform to use as part of update check. This MUST be overriden by a
# local settings file
platform = "unknown"
# Channel to use, alpha, beta, release, or semver which pulls it from the
# running program
channel = "semver"
# Interval in minutes between update checks
interval = 10
# The github release stream to check for updates
uri = "https://api.github.com/repos/helium/gateway-rs/releases"
# The command to run to install the update.
command = "/etc/helium_gateway/install_update"

[cache]
max_packets = 20

# A list of gateway service keys and urls (note https is not supported
[[gateways]]
# lgw-ireland
pubkey = "11tk4zzbyfMPYYHYda255ACoqfYFVdrUSoCWrCYfn8BoyuYrERK"
uri = "http://52.49.199.40:8080"

[[gateways]]
# lgw-ohio
pubkey = "115PmCR6fpFihdjw626JXYdUEdzwjh66yoWzWkMvB9CRGEx1U6G"
uri = "http://3.132.190.192:8080"

[[gateways]]
# lgw-oregon
pubkey = "11pUovhssQdXzrfcYMTUrNNTQossgny8WqhfdbprrAVFyHcmvAN"
uri = "http://35.84.173.125:8080"

[[gateways]]
# lgw-seoul
pubkey = "11yJXQPG9deHqvw2ac6VWtNP7gZj8X3t3Qb3Gqm9j729p4AsdaA"
uri = "http://3.38.70.101:8080"

[[gateways]]
# lgw-singapore
pubkey = "11Gx2yPEmBGUrbHUiUWQs9vV7JDHQLZSddQs6e3WB2uvqSMUDBW"
uri = "http://54.251.77.229:8080"

## Default routers for various release channels
[router.alpha]
# staging: oui 4
# pubkey = "11263KvqW3GZPAvag5sQYtBJSjb25azSTSwoi5Tza9kboaLRxcsv"
# uri = "http://54.193.165.228:8080"
# dev: oui 2
pubkey = "1124CJ9yJaHq4D6ugyPCDnSBzQik61C1BqD9VMh1vsUmjwt16HNB"
uri = "http://54.176.88.149:8080"

[router.beta]
# production
pubkey = "112qB3YaH5bZkCnKA5uRH7tBtGNv2Y5B4smv1jsmvGUzgKT71QpE"
uri = "http://52.8.80.146:8080"

[router.release]
# production: oui 1
pubkey = "112qB3YaH5bZkCnKA5uRH7tBtGNv2Y5B4smv1jsmvGUzgKT71QpE"
uri = "http://52.8.80.146:8080"
Bei-Ji-Quan commented 2 years ago

Hi,does the problem solved? I met the same problem also.

skiplyfrance commented 2 years ago

Hi,does the problem solved? I met the same problem also.

On my side, I gave up and switch to a solution where gateway-rs is on server side.

madninja commented 2 years ago

Hi,does the problem solved? I met the same problem also.

On my side, I gave up and switch to a solution where gateway-rs is on server side.

That doesn't quite make sense.. The logs seem to indicate the gateway-rs code has issues with the backend validatorserver it is talking to.. moving gateway-rs to a different host doesn't really solve issues in communicating with the validator

madninja commented 2 years ago

I've had no further reports on this and we've had an alpha.24 and .25 release that fixes some issues in this area. Please try again and open a new issue if you see errors