iotaledger / goshimmer

Prototype implementation of IOTA 2.0
https://wiki.iota.org/goshimmer/welcome
Apache License 2.0
389 stars 113 forks source link

Fatal Database error - node crushed #1093

Closed Phyloiota closed 3 years ago

Phyloiota commented 3 years ago

Bug description

Node was running constant over 26 hours, no issues so far, Mana ranking in the 20's ranks Not possible to access the dashboard anymore

GoShimmer version

0.5.2 Node ID: T36MBdhKwWM

Hardware specification

What hardware are you using?

Hetzner VPS CPX21

3 VCPU 4 GB RAM 80 GB DISK

Steps To reproduce the bug

Expected behaviour

Describe what you expect to happen.

Actual behaviour

Describe what actually happens.

Errors

Log file: Last login: Wed Mar 17 12:54:00 2021 from 182.1.72.33 root@ubuntu-4gb-hel1-2:~# $ docker logs -f --since=1m goshimmer $: command not found root@ubuntu-4gb-hel1-2:~# docker logs -f --since=1m goshimmer


/ __|/ \ / | | | | | \/ | \/ | | \ | | | | | | (_ | || | | | | \ / | \ / | | | |_) | | | | | | | |_ | | | | | |\/| | |\/| | | | / | || | || |____) | | | || || | | | | | | || | \ \ _|__/|__/|| ||____|| ||| |_|__|| \\ v0.5.2

2021-03-18T16:36:16+01:00 INFO Node banner/plugin.go:50 GoShimme r version v0.5.2 ... 2021-03-18T16:36:16+01:00 INFO Node banner/plugin.go:51 Loading plugins ... 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: Banner ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: Config ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: Logger ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: CLI ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: Graceful Shutdown ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: PortCheck ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: Profiling ... done 2021-03-18T16:36:16+01:00 INFO Node node/node.go:95 Loading Plugin: Database ... done 2021-03-18T16:36:18+01:00 INFO Local local/local.go:86 Initialized local: Peer{identity:T36MBdhKwWM, publicKey:5hoZQ9t8zbQrYisNY5sMLaX4LbEZ8JcC kAq1R6xgNoGW, host:0.0.0.0:14626} 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Autopeering ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: PoW ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Clock ... done Loading snapshot... TransactionID: 11111111111111111111111111111111 Address: ED25519Address { Digest: 0x7ec9638605ad394675d4730ec33581d44d4fb03af02f61b463cab5d94759d13e Base58: "19XvUnuAHqoWv7VumNqWLBHfT2M2wWWTi6BKGjNG4arFw" } Address Base58: 19XvUnuAHqoWv7VumNqWLBHfT2M2wWWTi6BKGjNG4arFw Balance: ColoredBalances { IOTA: 1000000000000000 } 2021-03-18T16:36:18+01:00 INFO MessageLayer node/plugin.go:99 r ead snapshot from /snapshot.bin 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: MessageLayer ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Gossip ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:86 Skipping Plugin: SyncBeacon 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: SyncBeaconFollower ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: DRNG ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:86 Skipping Plugin: Faucet 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Consensus ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Metrics ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Spammer ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Mana ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:86 Skipping Plugin: ManaEventLogger 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: RemoteLog ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:86 Skipping Plugin: Analysis-Server 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Analysis-Client ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:86 Skipping Plugin: Analysis-Dashboard 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Prometheus ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: NetworkDelay ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: Dashboard ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI data Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI DRNG Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI faucet Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI healthz Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI message Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI autopeering Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI info Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI Value Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:86 Skipping Plugin: WebAPI tools Endpoint 2021-03-18T16:36:18+01:00 INFO Node node/node.go:95 Loading Plugin: WebAPI Mana Endpoint ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:113 Executin g plugins ... 2021-03-18T16:36:18+01:00 INFO Node node/node.go:117 Starting Plugin: Banner ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:117 Starting Plugin: Config ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:117 Starting Plugin: Logger ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:117 Starting Plugin: CLI ... done 2021-03-18T16:36:18+01:00 INFO Node node/node.go:117 Starting Plugin: Graceful Shutdown ... done 2021-03-18T16:36:18+01:00 INFO PortCheck portcheck/plugin.go:40 T esting autopeering service ... 2021-03-18T16:36:18+01:00 INFO PortCheck portcheck/plugin.go:72 P ong received from 116.202.49.178 2021-03-18T16:36:20+01:00 INFO PortCheck portcheck/plugin.go:42 T esting autopeering service ... done 2021-03-18T16:36:20+01:00 INFO Node node/node.go:117 Starting Plugin: PortCheck ... done 2021-03-18T16:36:20+01:00 INFO Profiling profiling/plugin.go:52 P rofiling started, bind-address=0.0.0.0:6061 2021-03-18T16:36:20+01:00 INFO Node node/node.go:117 Starting Plugin: Profiling ... done 2021-03-18T16:36:20+01:00 FATAL Database database/plugin.go:93 T he database is marked as not properly shutdown/corrupted, please delete the data base folder and restart. github.com/iotaledger/goshimmer/plugins/database.configure /goshimmer/plugins/database/plugin.go:93 github.com/iotaledger/hive.go/node.pluginCaller /go/pkg/mod/github.com/iotaledger/hive.go@v0.0.0-20210314220918-ac82b832 2991/node/events.go:14 github.com/iotaledger/hive.go/events.(Event).Trigger /go/pkg/mod/github.com/iotaledger/hive.go@v0.0.0-20210314220918-ac82b832 2991/events/event.go:32 github.com/iotaledger/hive.go/node.(Node).Run /go/pkg/mod/github.com/iotaledger/hive.go@v0.0.0-20210314220918-ac82b832 2991/node/node.go:116 github.com/iotaledger/hive.go/node.Run /go/pkg/mod/github.com/iotaledger/hive.go@v0.0.0-20210314220918-ac82b832 2991/node/node.go:52 main.main /goshimmer/main.go:11 runtime.main /usr/local/go/src/runtime/proc.go:225 root@ubuntu-4gb-hel1-2:~# ^C root@ubuntu-4gb-hel1-2:~#

jonastheis commented 3 years ago

The log you posted does only show the symptom. The more interesting part is what happened before the node crashed the first time. But I suppose this is not relevant anymore now, therefore closing this issue.