NODE CRASH caused by a sudden memory and cpu soar

[marco-sundsk]

Describe the bug or test At height 34905, usage of mem and cpu both soar, cpu from 4% to 100%, mem from 0.39G to 4G and cause a oomkiller process. After auto restart, node then halt at heigh 34914, and say: Received Sync while Connecting from Outbound connection. And finally, node stuck at 35002, and says Downloading headers 100%.

How to Reproduce Steps to reproduce the behavior:

1. Happened at 2019-11-13T06:35:29
2. see screen shot for detail info

Expected behavior OR Outcome of test running smoothly.

Specs (please complete the following information):

• OS: Ubuntu 18.04
  • Which cloud / on-premise: AliYun
  • CPU: Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
  • RAM: 4G
  • Disk space: 500G SSD

Additional context

Screenshots Optional first shot:

after auto restart:

at some point of restarting, it shows different:

finally:

[bowenwang1996]

The bug is fixed in https://github.com/nearprotocol/nearcore/pull/1688