Error Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams"

rootwarp commented 1 year ago

Indexing with substream is not working after update fireeth and graph-node.

Versions

fireeth: fireeth version 1.4.0 (Commit 8d0beff, Built 2023-05-05T14:54:49Z) graph-node: graphprotocol/graph-node:v0.31.0-rc.0

Issued subgraph

QmeWyu8pzV3zViL5nz813NxKSab7REh9qJBivjzkCzE9Vw

Configs

fireeth config

start:
  args:
  - merger
  - firehose
  - reader-node
  - relayer
  - combined-index-builder
  flags:
    data-dir: /mnt/firehose
    firehose-grpc-listen-addr: 0.0.0.0:13042
    reader-node-ipc-path: /mnt/el/geth.ipc
    common-chain-id: "1"
    common-network-id: "1"
    reader-node-path: /usr/local/bin/geth
    substreams-rpc-endpoints: https://ethereum-mainnet-archive.allthatnode.com
    substreams-enabled: true
    substreams-request-stats-enabled: true
    reader-node-arguments: "--mainnet --port 30303 --cache 2048 --http --http.api=eth,net,web3 --http.addr 0.0.0.0 --http.port 8545 --http.vhosts=* --authrpc.addr 127.0.0.1 --authrpc.port 8551 --authrpc.jwtsecret /mnt/el/jwt.hex --gcmode full --datadir /mnt/el --ipcpath /mnt/el/geth.ipc --firehose-enabled --maxpeers=200 --metrics --metrics.addr 0.0.0.0 --metrics.port 7071"

graph-node config.


[chains.mainnet]
shard = "primary"
protocol = "ethereum"

provider = [
        { label = "eth-rpc-atn-archive", url = "https://ethereum-mainnet-archive.allthatnode.com/", features = [ "archive" ] },
        { label = "eth-firehose", details = { type = "substreams", url = "http://-.-.-.-:13042" } }
]

Logs

Error logs from fireeth.

2023-05-06T03:34:00.538Z INFO (firehose.tier1) job completed {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "job": {"module_name": "store_supply", "start_block": 12975000, "end_block": 12985000}, "error": "receiving stream resp: rpc error: code = Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams"}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) shutting down request stats {"trace_id": "19df1b8bd94c148f72414f3a43d38a29"}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) unexpected termination of stream of blocks {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "error": "error building pipeline: failed setup request: parallel processing run: scheduler run: process job result for target \"store_supply\": worker ended in error: receiving stream resp: rpc error: code = Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams"}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) worker failed with retryable error {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "error": "receiving stream resp: rpc error: code = Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams"}
2023-05-06T03:34:00.538Z ERRO (firehose) finished streaming call with code Internal {"grpc.start_time": "2023-05-06T03:33:54Z", "system": "grpc", "span.kind": "server", "grpc.service": "sf.substreams.rpc.v2.Stream", "grpc.method": "Blocks", "peer.address": "142.93.100.242:59116", "error": "rpc error: code = Internal desc = error building pipeline: failed setup request: parallel processing run: scheduler run: process job result for target \"store_supply\": worker ended in error: receiving stream resp: rpc error: code = Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams", "grpc.code": "Internal", "grpc.time_ms": 6008.35693359375}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) job completed {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "job": {"module_name": "store_supply", "start_block": 12985000, "end_block": 12995000}, "error": "receiving stream resp: rpc error: code = Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams"}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) worker failed with retryable error {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "error": "receiving stream resp: rpc error: code = Unimplemented desc = unknown service sf.substreams.internal.v2.Substreams"}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) launching remote worker {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "start_block_num": 13015000, "stop_block_num": 13025000, "output_module": "store_supply"}
2023-05-06T03:34:00.538Z INFO (firehose.tier1) worker failed with a non-retryable error {"trace_id": "19df1b8bd94c148f72414f3a43d38a29", "error": "context canceled"}

Tried remove $FIREHOSE_DIR/localdata, but not working.

sduchesneau commented 1 year ago

Ok, this fails because there is no "tier2" configured and accessible. In these cases, the substreams instance should provide both services (tier1=sf.substreams.rpc, tier2=sf.substreams.internal).

We'll provide a fix.

sduchesneau commented 1 year ago

fixed here: https://github.com/streamingfast/firehose-ethereum/releases/tag/v1.4.1

rootwarp commented 1 year ago

fixed here: https://github.com/streamingfast/firehose-ethereum/releases/tag/v1.4.1

Great. I'll test ASAP /w graph-node:v0.31.0-rc.0 and share the result ASAP.

thanks.

rootwarp commented 1 year ago

@sduchesneau I tested firehose v1.4.1 with graph-node v0.31.0-rc.0.

The subgraph QmeWyu8pzV3zViL5nz813NxKSab7REh9qJBivjzkCzE9Vw is indexing very well, so I think this issue seems resolved.

thanks.

matthewdarwin commented 1 year ago

close this issue?

streamingfast / firehose-ethereum