Sync is very slow

[vae520283995]

The sync was slow these two days, and now it's 7 hours behind Below is the log

May 10 02:50:42 ip-172-31-11-45 terrad[20100]: 2:50AM INF client state updated client-id=07-tendermint-101 height=1-381923 module=x/ibc/client
May 10 02:50:50 ip-172-31-11-45 terrad[20100]: 2:50AM INF burned tokens from module account amount=3120843252uluna from=market module=x/bank
May 10 02:50:50 ip-172-31-11-45 terrad[20100]: 2:50AM INF minted coins from module account amount=150141605953uusd from=market module=x/bank
May 10 02:50:51 ip-172-31-11-45 terrad[20100]: 2:50AM INF packet sent dst_channel=channel-18 dst_port=transfer module=x/ibc/channel sequence=3419 src_channel=channel-7 src_port=transfer
May 10 02:50:51 ip-172-31-11-45 terrad[20100]: 2:50AM INF IBC fungible token transfer amount=73000000 module=x/ibc-transfer receiver=sif1axcp5enff8y3huz86u90shhh04d3the9ykz78s sender=terra1sz6h573e5ke6vjlq5z79mvakuj2c64s4km0mcy token=uluna
May 10 02:50:54 ip-172-31-11-45 terrad[20100]: 2:50AM INF packet sent dst_channel=channel-72 dst_port=transfer module=x/ibc/channel sequence=259368 src_channel=channel-1 src_port=transfer
May 10 02:50:54 ip-172-31-11-45 terrad[20100]: 2:50AM INF IBC fungible token transfer amount=50000000 module=x/ibc-transfer receiver=osmo1hdsmz2kqftgk2ypa5t62aauvl0y3c2nfzvy6re sender=terra1hdsmz2kqftgk2ypa5t62aauvl0y3c2nfvnd2ht token=uusd
May 10 02:50:54 ip-172-31-11-45 terrad[20100]: 2:50AM INF burned tokens from module account amount=95374084uluna from=market module=x/bank
May 10 02:50:54 ip-172-31-11-45 terrad[20100]: 2:50AM INF minted coins from module account amount=4588381082uusd from=market module=x/bank
May 10 02:50:56 ip-172-31-11-45 terrad[20100]: 2:50AM INF executed block height=7571671 module=state num_invalid_txs=190 num_valid_txs=542
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=7 numToDial=3
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Will dial address addr={"id":"3c9eb18fa74b84ec79352cfb7a080a2c80f55a33","ip":"52.79.185.196","port":26656} module=pex
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Will dial address addr={"id":"0fbee3f69d9e5a66bc3ed0a0b8f805d70401b9d7","ip":"13.125.9.151","port":26656} module=pex
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Will dial address addr={"id":"b661aab6431d5c5520f907309be4c40a4ffb4d6a","ip":"3.145.17.125","port":26656} module=pex
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Dialing peer address={"id":"b661aab6431d5c5520f907309be4c40a4ffb4d6a","ip":"3.145.17.125","port":26656} module=p2p
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Dialing peer address={"id":"3c9eb18fa74b84ec79352cfb7a080a2c80f55a33","ip":"52.79.185.196","port":26656} module=p2p
May 10 02:50:59 ip-172-31-11-45 terrad[20100]: 2:50AM INF Dialing peer address={"id":"0fbee3f69d9e5a66bc3ed0a0b8f805d70401b9d7","ip":"13.125.9.151","port":26656} module=p2p
May 10 02:51:00 ip-172-31-11-45 terrad[20100]: 2:51AM ERR dialing failed (attempts: 1): dial tcp 13.125.9.151:26656: i/o timeout addr={"id":"0fbee3f69d9e5a66bc3ed0a0b8f805d70401b9d7","ip":"13.125.9.151","port":26656} module=pex
May 10 02:51:00 ip-172-31-11-45 terrad[20100]: 2:51AM ERR dialing failed (attempts: 3): dial tcp 3.145.17.125:26656: i/o timeout addr={"id":"b661aab6431d5c5520f907309be4c40a4ffb4d6a","ip":"3.145.17.125","port":26656} module=pex
May 10 02:51:00 ip-172-31-11-45 terrad[20100]: 2:51AM ERR dialing failed (attempts: 1): dial tcp 52.79.185.196:26656: i/o timeout addr={"id":"3c9eb18fa74b84ec79352cfb7a080a2c80f55a33","ip":"52.79.185.196","port":26656} module=pex
May 10 02:51:03 ip-172-31-11-45 terrad[20100]: 2:51AM INF commit synced commit=436F6D6D697449447B5B3233203138342031373120323234203434203135332031343520313520313430203134342032313220383820313231203635203130392032323420343220363820313932203331203235332032303720323439203938203139322031363920313737203132352032313420333220313637203130395D3A3733383844377D
May 10 02:51:03 ip-172-31-11-45 terrad[20100]: 2:51AM INF committed state app_hash=17B8ABE02C99910F8C90D45879416DE02A44C01FFDCFF962C0A9B17DD620A76D height=7571671 module=state num_txs=732
May 10 02:51:03 ip-172-31-11-45 terrad[20100]: 2:51AM INF indexed block height=7571671 module=txindex
May 10 02:51:08 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=1094227329uluna from=market module=x/bank
May 10 02:51:08 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=52642518444uusd from=market module=x/bank
May 10 02:51:14 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379522686uluna from=market module=x/bank
May 10 02:51:14 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18258573395uusd from=market module=x/bank
May 10 02:51:14 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379381140uluna from=market module=x/bank
May 10 02:51:14 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18251763715uusd from=market module=x/bank
May 10 02:51:14 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=22220469uluna from=market module=x/bank
May 10 02:51:14 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=1069011363uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379239673uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18244957836uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=378928822uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18230003009uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=378928822uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18230003009uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=20875465uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=1004304153uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=378928822uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18230003009uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=379098284uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18238155709uusd from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF burned tokens from module account amount=378928822uluna from=market module=x/bank
May 10 02:51:15 ip-172-31-11-45 terrad[20100]: 2:51AM INF minted coins from module account amount=18230003009uusd from=market module=x/bank

[vae520283995]

The hardware configuration is cpu 8 core, memory 32g, 5000 iops

[vae520283995]

@hanjukim please help

[luoxiandong]

I have same problom,The peer should be invalid. Is there some valid peers?

[vae520283995]

I have same problom,The peer should be invalid. Is there some valid peers?

@luoxiandong Did you solve it?

[xynor]

I also meet the same problem, low cpu and storage usage, many timeout peer connection. syncing very slow.

[luoxiandong]

I have same problom,The peer should be invalid. Is there some valid peers?

@luoxiandong Did you solve it?

Not resolved, More than 5,000 heights are now behind。

[xynor]

@luoxiandong @vae520283995 Hey, you guys solved it?

[vae520283995]

@luoxiandong @vae520283995 Hey, you guys solved it?

Not yet, I'm going to re-download the snapshot sync

[vae520283995]

After syncing via latest snapshot yesterday, it's behind again today

[xynor]

LUNA R.I.P

[NeedForPerfect]

So If developers fix this issue - the price will be 100$.

[vae520283995]

Resync from snapshot will resolve