Closed fabio-nukui closed 2 years ago
Update Core to v0.5.11
@hanjukim As in the report, this error is still happening here with v0.5.11. I am using the pre-compiled release at https://github.com/terra-money/core/releases/download/v0.5.11/terra_0.5.11_Linux_x86_64.tar.gz
Thank you for your finding. Did you also send broadcast txs to the node as well?
Yes, I broadcasted txs with the node as well
I did following actions with my node:
Seems v0.16.2
is fix for other problem(some vector managing) in libwasmvm
, it is still problem.
@ivanfong01 @fabio-nukui
For temporal fix, you can bump Tendermint version to latest. It will make your node to handle wasm query in single thread.
@YunSuk-Yeo Thanks for the tip!
I will test this branch and see if there are stability / performance issues.
The new cosmos-sdk and tendermint versions seem to solve this issue.
I am running a few nodes with v0.5.11 and a few with the new versions. The v0.5.11 nodes froze ~5 times each today, the new nodes didn't freeze a single time.
I also didn't see significant performance differences in my applications.
ok, seems this problem only happens in multi thread query env. Thanks for confirmation.
I think this took down our relayer yesteraday.
@YunSuk-Yeo found a way to reproduce the problem. https://github.com/wasmerio/wasmer/issues/2434#issuecomment-1032281200
following up https://github.com/terra-money/core/issues/683
Describe the bug
Same bug as reported in #599, using
v0.5.11
. Node has to be restarted multiple times a daySnippets of the logs:
...
To Reproduce
Run
terrad
with heavy query loads (my application mostly decodes mempool transactions and queries contracts).Context & versions
v0.5.11 Linux release build, running inside docker image based on
ubuntu:focal-20211006
terrad version --long
: