palomachain / paloma

The fast blockchain messenger protocol
Apache License 2.0
290 stars 135 forks source link

BUG: [Cosmos v0.50.5] failed to load latest version: failed to load store: Value missing for key after chain restart #1121

Closed taariq closed 7 months ago

taariq commented 7 months ago

What is happening?

Section description Provide as much context as you can. Give as much context as you can to make it easier for the developers to figure what is happening.

SEVEN VALIDATORS with the same error:

validator 1: failed to load latest version: failed to load store: Value missing for key [0 0 0 0 0 241 183 176 0 0 0 1] corresponding to nodeKey 730000000000f1b7b000000001 [/home/paloma/go/pkg/mod/cosmossdk.io/store@v1.0.2/rootmulti/store.go:255]

Validator 2: failed to load latest version: failed to load store: Value missing for key [0 0 0 0 0 241 183 176 0 0 0 1] corresponding to nodeKey 730000000000f1b7b000000001 [/home/runner/go/pkg/mod/cosmossdk.io/store@v1.0.2/rootmulti/store.go:255]

Paloma and pigeon versions and logs

Section description Write down paloma version. Write down pigeon version. Copy and paste pigeon config file as well as relevant ENV variables.

palomad version v1.13.1

How to reproduce?

Section description Please write detailed steps of what you were doing for this bug to appear.

Upgrading at Chain Halt.

What is the expected behaviour?

Section description If you know, please write down what is the expected behaviour. If you don't know, that's ok. We can have a discussion in comments.

No key not foun

byte-bandit commented 7 months ago

Emitted from here https://github.com/cosmos/cosmos-sdk/blob/2a199f57c5902b4a0ba368d74b344148772500c7/store/rootmulti/store.go#L253

taariq commented 7 months ago

This was due to bad migration of iavl 1.0.3 from the v0. version.

taariq commented 7 months ago

Fixed with https://github.com/palomachain/paloma/pull/1116