search

koinos / koinos-p2p

The p2p microservice orchestrates the distribution of blocks and transactions between peers.
MIT License
6 stars 4 forks source link

GetTopologyAtHeight - Block not present #112

Closed mvandeberg closed 3 years ago

mvandeberg commented 3 years ago

When running a remote p2p node, it was stuck request a block topology. The block ID Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18 has a base58 encoding of zQmZJgwEhY6oaBgupXXwYeyWmResFKN1fwyHEZaM58MrdLU (You can confirm this with a base 58 encode/decode)

On my local node I see application of the block both in p2p and chain:

local p2p:

2021-06-11 00:24:19.298441 (p2p.Koinos) [protocol/gossip.go:187] <info>: Gossiped block applied: Height: 1024 ID: zQmZJgwEhY6oaBgupXXwYeyWmResFKN1fwyHEZaM58MrdLU Prev: zQmW9fPUzFTyDsorrm6srNKxJa9rZfqnZnFEnyrXkVzjhLo from peer QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd
2021-06-11 00:24:19.597402 (p2p.Koinos) [protocol/gossip.go:187] <info>: Gossiped block applied: Height: 1025 ID: zQmXAX9dcaqFpdUyvGpU9hhr96vPLQ8cumhXANAGezDKbGX Prev: zQmZJgwEhY6oaBgupXXwYeyWmResFKN1fwyHEZaM58MrdLU from peer QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd

local chain:

block 1024 is the relevant block. There does not appear to be any forking.

2021-06-10 17:24:12.685521 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1021, ID: "zQmUjGbA7Xc25vYmRKZrWShjr2cjWiohrr6CnmQ4XjRoByS"
2021-06-10 17:24:12.764269 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1021, ID: "zQmUjGbA7Xc25vYmRKZrWShjr2cjWiohrr6CnmQ4XjRoByS"
2021-06-10 17:24:17.639447 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1022, ID: "zQmUVKpzeZG4FzUjvuQS1S3cgYvdTZB4rcjYMuQesrfJGYJ"
2021-06-10 17:24:17.718268 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1022, ID: "zQmUVKpzeZG4FzUjvuQS1S3cgYvdTZB4rcjYMuQesrfJGYJ"
2021-06-10 17:24:18.230886 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1023, ID: "zQmW9fPUzFTyDsorrm6srNKxJa9rZfqnZnFEnyrXkVzjhLo"
2021-06-10 17:24:18.314542 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1023, ID: "zQmW9fPUzFTyDsorrm6srNKxJa9rZfqnZnFEnyrXkVzjhLo"
2021-06-10 17:24:19.205774 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1024, ID: "zQmZJgwEhY6oaBgupXXwYeyWmResFKN1fwyHEZaM58MrdLU"
2021-06-10 17:24:19.283826 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1024, ID: "zQmZJgwEhY6oaBgupXXwYeyWmResFKN1fwyHEZaM58MrdLU"
2021-06-10 17:24:19.502616 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1025, ID: "zQmXAX9dcaqFpdUyvGpU9hhr96vPLQ8cumhXANAGezDKbGX"
2021-06-10 17:24:19.582772 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1025, ID: "zQmXAX9dcaqFpdUyvGpU9hhr96vPLQ8cumhXANAGezDKbGX"
2021-06-10 17:24:21.847934 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1026, ID: "zQmRANSGTzhJB9pUscRXyZ74fPdX69mA5poZ3uKbdr6S92W"
2021-06-10 17:24:21.935779 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1026, ID: "zQmRANSGTzhJB9pUscRXyZ74fPdX69mA5poZ3uKbdr6S92W"
2021-06-10 17:24:22.047511 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1027, ID: "zQmRY7syeaauJnjCChQe8bFaRbcNvaK68uPFm7dRY74Qqeg"
2021-06-10 17:24:22.129177 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1027, ID: "zQmRY7syeaauJnjCChQe8bFaRbcNvaK68uPFm7dRY74Qqeg"
2021-06-10 17:24:23.073428 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1028, ID: "zQmTtoL2pHupJ9YaxHtFN5kWVhftPqng6ysrBFYiSrgGouh"
2021-06-10 17:24:23.153011 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1028, ID: "zQmTtoL2pHupJ9YaxHtFN5kWVhftPqng6ysrBFYiSrgGouh"
2021-06-10 17:24:24.018286 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1029, ID: "zQmSfiMuetKu9qy3Aaece539eqUFf6oBwbRWDFcchgX1MDF"
2021-06-10 17:24:24.097694 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1029, ID: "zQmSfiMuetKu9qy3Aaece539eqUFf6oBwbRWDFcchgX1MDF"
2021-06-10 17:24:26.966260 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1030, ID: "zQmdAUg5Gc6h9XYV3YvQEE95UYfSvzRNLhxohXBXFY58dLr"
2021-06-10 17:24:27.055998 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1030, ID: "zQmdAUg5Gc6h9XYV3YvQEE95UYfSvzRNLhxohXBXFY58dLr"
2021-06-10 17:24:29.855579 (chain.Koinos) [controller.cpp:130] <info>: Pushing block - Height: 1031, ID: "zQmdtbziqyiUokkCwDCGjWK2xmsizm87sMNwmeTwY8qXp9d"
2021-06-10 17:24:29.938234 (chain.Koinos) [controller.cpp:158] <info>: Block application successful - Height: 1031, ID: "zQmdtbziqyiUokkCwDCGjWK2xmsizm87sMNwmeTwY8qXp9d"

remote p2p:

2021-06-11 00:24:11.797956 (p2p.Koinos) [protocol/download_provider.go:219] <info>: Downloaded block applied - Height: 1020 ID: zQmWWfUCv7dS21gJdGjArWjkn8GsBQG2XwxX62HBCGBCqix Prev: zQmWH99U49DRqZNhXHWvgoQZJumNKkPD6pjwR5ARDpPP2Px from peer QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd
2021-06-11 00:24:13.926480 (p2p.Koinos) [protocol/download_provider.go:219] <info>: Downloaded block applied - Height: 1021 ID: zQmUjGbA7Xc25vYmRKZrWShjr2cjWiohrr6CnmQ4XjRoByS Prev: zQmWWfUCv7dS21gJdGjArWjkn8GsBQG2XwxX62HBCGBCqix from peer QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd
2021-06-11 00:24:18.434917 (p2p.Koinos) [protocol/download_provider.go:219] <info>: Downloaded block applied - Height: 1022 ID: zQmUVKpzeZG4FzUjvuQS1S3cgYvdTZB4rcjYMuQesrfJGYJ Prev: zQmUjGbA7Xc25vYmRKZrWShjr2cjWiohrr6CnmQ4XjRoByS from peer QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd
2021-06-11 00:24:18.437425 (p2p.Koinos) [protocol/gossip.go:187] <info>: Gossiped block applied: Height: 1022 ID: zQmUVKpzeZG4FzUjvuQS1S3cgYvdTZB4rcjYMuQesrfJGYJ Prev: zQmUjGbA7Xc25vYmRKZrWShjr2cjWiohrr6CnmQ4XjRoByS from peer Qmf4Rz6Yg6YnaNpqQoUxDepn2ceAeEMvPv9C4R3hJVDqY3
2021-06-11 00:24:20.403162 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:22.538202 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:24.610052 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:26.682911 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:28.754396 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:30.826566 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:32.962866 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:35.099950 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
2021-06-11 00:24:37.230986 (p2p.Koinos) [protocol/peer_handler.go:197] <warn>: QmTG6kNpsa3yESyxS462BGsyVMsvNsYMFe662os6ZzghRd: error calling GetTopologyAtHeight, error was Block not present - Digest: By3E8ZYb2ai4KB7MuLwVrbhfMmTmN2PHCvYieuj3ewGU, ID: 18
theoreticalbts commented 3 years ago

The error is from the block store.

The question is, what happened in the block store? Logs from the block store are needed for further analysis.

sgerbino commented 3 years ago

Unable to reproduce with latest code.