distributable node snapshot

[pro-wh]

suppose I have a "serverdir" of a node that's synced. Someone wants to get my copy of that.

goal:

1. formulate instructions for how to prepare a distributable (i.e. no secret information) bundle of a synced node's state so that recipient can get chain history from a trusted source done
2. possibly make a tool that can prepare this bundle

[kostko]

You mean something like this https://docs.oasis.dev/general/run-a-node/advanced/copy-state-from-one-node-to-the-other?

[pro-wh]

oh ok yeah. since we have that written up, let's go ahead and check that first item off the list then

[valentinbud]

One of the validators, @Bambarello, is already providing such a snapshot.

See https://github.com/Bambarello/cosmos-snapshots and http://snapshots.alexvalidator.com:8081/. Is this what you mean @pro-wh?

[pro-wh]

Yeah, I think those are the kind of snapshot. Thanks for sharing the links.

The remaining item in this issue is about adding a tool for creating those snapshots.

[tjanez]

We now also have Oasis Snapshots (https://snapshots.oasis.io/), an official service providing Oasis Network snapshots.

[blocknodehub]

However, there is no snapshot data for the latest version (oasis-4)

[kostko]

You should be able to sync the latest version from genesis very quickly so no snapshot is needed yet ;)

[blocknodehub]

I used statesync to start up, but I couldn't sync the data Config: mode: client common: data_dir: /mnt/rosemain/node/data log: format: JSON level: cometbft: info cometbft/context: error default: info consensus: state_sync: enabled: true trust_height: 16824024 trust_hash: "14e2c486579a1c03b5109a7acf86e2c65c497ed6210caa2e99179541e5cb4eda" prune: num_kept: 302400 strategy: keep_n genesis: file: /mnt/rosemain/node/etc/genesis.json p2p: seeds:

• "H6u9MtuoWRKn5DKSgarj/dzr2Z9BsjuRHgRAoXITOcU=@35.199.49.168:26656"
• "H6u9MtuoWRKn5DKSgarj/dzr2Z9BsjuRHgRAoXITOcU=@35.199.49.168:9200"

Log: {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:44:49.414325124Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:45:04.415034754Z"} {"book":"/mnt/rosemain/node/data/consensus/config/addrbook.json","caller":"file.go:22","level":"info","module":"cometbft:p2p","msg":"Saving AddrBook to file","size":1085,"ts":"2023-11-30T11:45:18.727013682Z"} {"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":20,"numToDial":0,"ts":"2023-11-30T11:45:18.735701348Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:45:19.416151182Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:45:34.416845845Z"} {"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":20,"numToDial":0,"ts":"2023-11-30T11:45:48.735306778Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:45:49.417094676Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:46:04.41752527Z"} {"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":20,"numToDial":0,"ts":"2023-11-30T11:46:18.73557099Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:46:19.41792175Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:46:34.418528888Z"} {"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":20,"numToDial":0,"ts":"2023-11-30T11:46:48.735823202Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:46:49.419576246Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:47:04.419907974Z"} {"book":"/mnt/rosemain/node/data/consensus/config/addrbook.json","caller":"file.go:22","level":"info","module":"cometbft:p2p","msg":"Saving AddrBook to file","size":1085,"ts":"2023-11-30T11:47:18.72664222Z"} {"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":20,"numToDial":0,"ts":"2023-11-30T11:47:18.735879611Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:47:19.421371376Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:47:34.421647047Z"} {"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":20,"numToDial":0,"ts":"2023-11-30T11:47:48.736150056Z"} {"caller":"syncer.go:173","level":"info","module":"cometbft:statesync","msg":"Discovering snapshots for 15s","ts":"2023-11-30T11:47:49.421772657Z"}

[kostko]

It is too early for the new network for there to be any snapshots available. Just sync from genesis, it should be quite fast.

[blocknodehub]

I see what this means, the pre-V4 data is almost completely discarded, but the block height does not start at 0. Thank you very much