search

ava-labs / hypersdk

Opinionated Framework for Building Hyper-Scalable Blockchains on Avalanche
Other
203 stars 112 forks source link

Bug Report : Validator not being able to produce block in the targeted time window #1474

Open HyperPatrick opened 2 months ago

HyperPatrick commented 2 months ago

We were able to run a hyper vm with our custom VM on 5 local validators for 2 days. Then the chain halted because the stake of the validators was 60%, so less then 80%. Digging into the issue we saw that one of the validators wasn't able to produce a block in the given time window as you can see on this error : "block processing too long: 56.384497787s > 30s"

This resulted in the validator to shutdown and the other validators started to loose stake until the chain halted. This issue arrived at the production of the 45 000th block and no transaction were being issued on the chain, we were just testing the block production.

aaronbuchwald commented 2 months ago

Could you provide a zip of the log directory? Did you shut any of the 5 nodes down manually?

HyperPatrick commented 2 months ago

We changed our servers, so unfortunately, we don't have the logs from the previous node failure. We are now running a new chain and will send the logs if the issue arises again. We did not shut down any node manually, the validator killed itself after the error.

aaronbuchwald commented 2 months ago

Thanks 🙏