search

nodejs / node

Node.js JavaScript runtime ✨🐢🚀✨
https://nodejs.org
Other
106.19k stars 28.9k forks source link

"Fatal error, unreachable code" seen intermittently on v20.10.0 #51555

Open tomdee opened 7 months ago

tomdee commented 7 months ago

Version

v20.10.0

Platform

Linux codespaces-110a35 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Subsystem

No response

What steps will reproduce the bug?

Sorry, I don't have an easy repro.

How often does it reproduce? Is there a required condition?

I can't repro it reliably, it happens intermittently. In CI, I'm seeing it a few times per day

What is the expected behavior? Why is that the expected behavior?

It shouldn't crash

What do you see instead?


#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7fffaf0a2d00
 1: 0xd17f41  [node]
 2: 0x20fe211 V8_Fatal(char const*, ...) [node]
 3: 0x10c1d84 v8::internal::HeapAllocator::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
 4: 0x10c2ef5 v8::internal::HeapAllocator::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
 5: 0x1534cea v8::internal::Heap::AllocateRawOrFail(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
 6: 0x1535fb2 v8::internal::Deserializer<v8::internal::Isolate>::Allocate(v8::internal::AllocationType, int, v8::internal::AllocationAlignment) [node]
 7: 0x1539589 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 8: 0x1539909 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
 9: 0x153a20f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
10: 0x1539556 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
11: 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
12: 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
13: 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
14: 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
15: 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
16: 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
17: 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
18: 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
19: 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
20: 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
21: 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
22: 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
23: 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
24: 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[25](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:26): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[26](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:27): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[27](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:28): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[28](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:29): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[29](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:30): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[30](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:31): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[31](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:32): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[32](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:33): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[33](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:34): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[34](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:35): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[35](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:36): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[36](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:37): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[37](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:38): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[38](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:39): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[39](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:40): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[40](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:41): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[41](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:42): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[42](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:43): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[43](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:44): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[44](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:45): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[45](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:46): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[46](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:47): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[47](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:48): 0x153822b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
[48](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:49): 0x1539361 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
[49](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:50): 0x1539628 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
[50](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:51): 0x1539909 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
[51](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:52): 0x153a20f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
[52](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:53): 0x1[53](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:54)eda2 v8::internal::ObjectDeserializer::Deserialize() [node]
53: 0x153efb4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
[54](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:55): 0x1531cf2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
[55](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:56): 0xf8bd6b  [node]
[56](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:57): 0xf8c04d v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
[57](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:58): 0xeebdcc  [node]
[58](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:59): 0xeebed8 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
[59](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:60): 0xc8c3fe node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
[60](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:61): 0xf29f4f v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
[61](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:62): 0xf2a505  [node]
[62](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:63): 0xf2ac23 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
[63](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:64): 0x1[93](https://github.com/VantaInc/obsidian/actions/runs/7187223522/job/19574346489#step:5:94)4df6  [node]
Trace/breakpoint trap (core dumped)

### Additional information

I'm running node using `ts-node`. 
It's being called from a Makefile and several `ts-node` invocations are happening in parallel.
anonrig commented 7 months ago

We are seeing similar issues with Node.js 20 on Sentry javascript sdk repository. I couldn't find a repro as well. @joyeecheung Any suggestions?

joyeecheung commented 7 months ago

Without a repro it's hard to tell what's going on here. From the stack trace it could be a V8 bug.

joyeecheung commented 7 months ago

By the way if a core dump is available that would make it easier to get to clues about what was happening.

chuzarski commented 5 months ago

Hello!

I'm currently facing what seems to be the same issue in CI. This occurs on Node 20 (specifically, 20.8.0, 20.10.0, 20.11.0). Our build workers run on Amazon Linux 2023 and we build with 4 parallel processes with Nx.

I did retireve core dumps of these crashes, unfortunately I'm unable to provide them, but I can provide the stack traces from gdb.

This crash:

#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7fff4862fc50
----- Native stack trace -----

 1: 0xd2a6e1  [node]
 2: 0x210ea81 V8_Fatal(char const*, ...) [node]
 3: 0x153838c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
 4: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
 5: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 6: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
 7: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
 8: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 9: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
10: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
11: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
12: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
13: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
14: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
16: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
17: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
18: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
19: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
20: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
22: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
23: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
24: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
25: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
26: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
28: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
29: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
30: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
31: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
32: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
33: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
34: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
35: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
36: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
37: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
38: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
39: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
40: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
41: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
42: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
43: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
44: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
45: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
46: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
47: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
48: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
49: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
50: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
51: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
52: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
53: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
54: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
55: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
56: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
57: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
58: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
59: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
60: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
61: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
62: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
63: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
64: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
65: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
66: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
67: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
68: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
69: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
70: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
71: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
72: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
73: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
74: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
75: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
76: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
77: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
78: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
79: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
80: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
81: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
82: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
83: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
84: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
85: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
86: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
87: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
88: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
89: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
90: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
91: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
92: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
93: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
94: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
95: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
96: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
97: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
98: 0x153d1c2 v8::internal::ObjectDeserializer::Deserialize() [node]
99: 0x153d3d4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
100: 0x152fff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
101: 0xf969eb  [node]
102: 0xf96ccd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
103: 0xef5b0f  [node]
104: 0xef5c28 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
105: 0xc9cd8d node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
106: 0xf3451e v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
107: 0xf34ad2  [node]
108: 0xf351e3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
109: 0x19331b6  [node]

Has the following stack trace in gdb:

#0  0x000000000211b0fe in v8::internal::MemCopy (size=<error reading variable: Cannot access memory at address 0x48>, src=0x0, dest=0x7f11409fba40) at ../deps/v8/src/utils/memcopy.h:91
#1  v8::internal::RegExpBytecodeGenerator::Copy (a=0x7f11409fba40 "", this=0x0) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:397
#2  v8::internal::RegExpBytecodeGenerator::GetCode (this=0x0, source=...) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:388
#3  0x00007fff4862ff30 in ?? ()
#4  0x00007fff4862fe60 in ?? ()
#5  0x00000000decade10 in ?? ()
#6  0x6168636165726e75 in ?? ()
#7  0x65646f6320656c62 in ?? ()
#8  0x0000000000000000 in ?? ()

And this crash:

#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7ffdb38fb680
----- Native stack trace -----

 1: 0xd2a6e1  [node]
 2: 0x210ea81 V8_Fatal(char const*, ...) [node]
 3: 0x153838c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
 4: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
 5: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 6: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
 7: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
 8: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 9: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
10: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
11: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
12: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
13: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
14: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
16: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
17: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
18: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
19: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
20: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
22: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
23: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
24: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
25: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
26: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
28: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
29: 0x153d1c2 v8::internal::ObjectDeserializer::Deserialize() [node]
30: 0x153d3d4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
31: 0x152fff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
32: 0xf969eb  [node]
33: 0xf96ccd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
34: 0xef5b0f  [node]
35: 0xef5c28 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
36: 0xc9cd8d node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
37: 0xf3451e v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
38: 0xf34ad2  [node]
39: 0xf351e3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
40: 0x19331b6  [node]

 NX Command failed: pnpm --version

   #
   # Fatal error in , line 0
   # unreachable code
   #
   #
   #
   #FailureMessage Object: 0x7ffdb38fb680
   ----- Native stack trace -----

    1: 0xd2a6e1  [node]
    2: 0x210ea81 V8_Fatal(char const*, ...) [node]
    3: 0x153838c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
    4: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
    5: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
    6: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
    7: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
    8: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
    9: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
   10: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
   11: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
   12: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
   13: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
   14: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
   15: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
   16: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
   17: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
   18: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
   19: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
   20: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
   21: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
   22: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
   23: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
   24: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
   25: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
   26: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
   27: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
   28: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
   29: 0x153d1c2 v8::internal::ObjectDeserializer::Deserialize() [node]
   30: 0x153d3d4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
   31: 0x152fff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
   32: 0xf969eb  [node]
   33: 0xf96ccd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
   34: 0xef5b0f  [node]
   35: 0xef5c28 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
   36: 0xc9cd8d node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
   37: 0xf3451e v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
   38: 0xf34ad2  [node]
   39: 0xf351e3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
   40: 0x19331b6  [node]

With the following stack trace in gdb:

#0  0x000000000211b0fe in v8::internal::MemCopy (size=<error reading variable: Cannot access memory at address 0x48>, src=0x0, dest=0x7f1e595fba40) at ../deps/v8/src/utils/memcopy.h:91
#1  v8::internal::RegExpBytecodeGenerator::Copy (a=0x7f1e595fba40 "", this=0x0) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:397
#2  v8::internal::RegExpBytecodeGenerator::GetCode (this=0x0, source=...) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:388
#3  0x00007ffdb38fb960 in ?? ()
#4  0x00007ffdb38fb890 in ?? ()
#5  0x00000000decade10 in ?? ()
#6  0x6168636165726e75 in ?? ()
#7  0x65646f6320656c62 in ?? ()
#8  0x0000000000000000 in ?? ()

Ocassionally the following error will occur as well:

#
# Fatal error in , line 0
# Check failed: current == end_slot_index.
#
#
#
#FailureMessage Object: 0x7fff93f1da60
 1: 0xd15331  [node]
 2: 0x20ef531 V8_Fatal(char const*, ...) [node]
 3: 0x1535691  [node]
 4: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 5: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
 6: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
 7: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 8: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
 9: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
10: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
11: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
12: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
13: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
14: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
15: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
16: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
17: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
18: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
19: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
20: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
21: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
22: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
23: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
24: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
25: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
26: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
27: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
28: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
29: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
30: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
31: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
32: 0x1535c09 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
33: 0x153650f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
34: 0x153b0a2 v8::internal::ObjectDeserializer::Deserialize() [node]
35: 0x153b2b4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
36: 0x152dff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
37: 0xf8871b  [node]
38: 0xf889fd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
39: 0xee877c  [node]
40: 0xee8888 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
41: 0xc8817e node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
42: 0xf268ff v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
43: 0xf26eb5  [node]
44: 0xf275d3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
45: 0x1930df6  [node]

However I have been unable to collect a core dump of this error occuring.

Interestingly, these errors typically coincide with Nx printing: NX Command failed: pnpm --version. Not sure how that could correlate.

Hopefully this can help with this issue.

Thanks!

joyeecheung commented 5 months ago

IIUC this and OP were both running into issues in a similar setup in https://github.com/actions/setup-node/issues/887 (with GitHub actions)?

From the OP of that issue, I suspect the caching GitHub does could interact poorly with a user land dependency that makes use of vm.Script. It can also be possible that this dependency is monkey patching the builtin CJS loader to compile data with code cache, and for some reason, the cache it uses is mismatching the version of Node.js in the CI, which is why in the other issue, OP reports that they were seeing wrong Node.js versions. AFAIK, one such popular package that does this is https://www.npmjs.com/package/v8-compile-cache - does this package show up in your dependency? If it does, does setting DISABLE_V8_COMPILE_CACHE=1 make the crash go away?

joyeecheung commented 5 months ago

Also, I am not sure if it still works on v20, but can you try using LLDB and https://github.com/nodejs/llnode to see if you can print the JS stack trace (the command is "v8 bt" with the plugin) from the core dump? The stack traces indicates that this crash comes from user land JS code, so that would help us pinpoint what JS code (likely a third party package) is causing the crash.

joyeecheung commented 5 months ago

From some quick search, it seems pnpm is using v8-compile-cache: https://github.com/search?q=repo%3Apnpm%2Fpnpm%20v8-compile-cache&type=code

And yarn seems to use that too, though I am not able to find where the code is: https://github.com/yarnpkg/berry/issues/5987

I noticed that v8-compile-cache only invalidates the cache when the content of the file changes and doesn't seem to do anything if the V8 version/Node.js version mismatches with the cache. That could be a source of bug like this. If DISABLE_V8_COMPILE_CACHE =1 makes the crash go away, then the crash would be introduced by this package.

chuzarski commented 5 months ago

Thank you for investigating this!

IIUC this and OP were both running into issues in a similar setup in https://github.com/actions/setup-node/issues/887 (with GitHub actions)?

I'm running into the same issue, but not with Github actions. I'm running into this issue with an Atlasssian Bamboo elastic build agent. This is occurring on a standard AWS EC2 instance, running Amazon Linux. Additionally, I've tested multiple Node 20 versions. Interestingly, this crash does not seem to occur on Windows. We have a project within the same monorepo that is built on Windows. As a result, pnpm and Nx are used there as well.

Also, I am not sure if it still works on v20, but can you try using LLDB and https://github.com/nodejs/llnode to see if you can print the JS stack trace

I'll give this a try and report back

If DISABLE_V8_COMPILE_CACHE =1 makes the crash go away, then the crash would be introduced by this package.

I will also give this a try and report back!

Thank you!

chuzarski commented 5 months ago

I set DISABLE_V8_COMPILE_CACHE=1 and I can confirm it seems to prevent these crashes for me. I have had 10/10 successful builds without any nodejs crashes. Before I was experiencing about a 3/10 success rate.

Also, it appears llnode still works with Node 20 :D. It also seems lldb prints a vastly different stack trace, compared to gdb.

core dump 1 has the follow stack trace:

 * thread #1: tid = 511004, 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14, name = 'node', stop reason = signal SIGTRAP
  * frame #0: 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14
    frame #1: 0x000000000210ea92 node-debug`V8_Fatal(char const*, ...) + 354
    frame #2: 0x000000000153838c node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 1820
    frame #3: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #4: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #5: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #6: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #7: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #8: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #9: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #10: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #11: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #12: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #13: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #14: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #15: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #16: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #17: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #18: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #19: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #20: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #21: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #22: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #23: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #24: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #25: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #26: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #27: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #28: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #29: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #30: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #31: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #32: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #33: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #34: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #35: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #36: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #37: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #38: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #39: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #40: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #41: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #42: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #43: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #44: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #45: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #46: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #47: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #48: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #49: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #50: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #51: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #52: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #53: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #54: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #55: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #56: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #57: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #58: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #59: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #60: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #61: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #62: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #63: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #64: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #65: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #66: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #67: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #68: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #69: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #70: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #71: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #72: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #73: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #74: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #75: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #76: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #77: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #78: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #79: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #80: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #81: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #82: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #83: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #84: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #85: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #86: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #87: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #88: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #89: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #90: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #91: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #92: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #93: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #94: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #95: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #96: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #97: 0x000000000153d1c2 node-debug`v8::internal::ObjectDeserializer::Deserialize() + 50
    frame #98: 0x000000000153d3d4 node-debug`v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) + 132
    frame #99: 0x000000000152fff2 node-debug`v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) + 626
    frame #100: 0x0000000000f969eb node-debug`v8::internal::(anonymous namespace)::GetSharedFunctionInfoForScriptImpl(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::Extension*, v8::internal::AlignedCachedData*, v8::internal::BackgroundDeserializeTask*, bool (*)(int, void*), void*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) (.constprop.0) + 4091
    frame #101: 0x0000000000f96ccd node-debug`v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) + 29
    frame #102: 0x0000000000ef5b0f node-debug`v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) (.part.0) + 1343
    frame #103: 0x0000000000ef5c28 node-debug`v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) + 72
    frame #104: 0x0000000000c9cd8d node-debug`node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) + 1885
    frame #105: 0x0000000000f3451e node-debug`v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) + 318
    frame #106: 0x0000000000f34ad2 node-debug`v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<true>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, unsigned long*, int) + 274
    frame #107: 0x0000000000f351e3 node-debug`v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) + 179
    frame #108: 0x00000000019331b6 node-debug`Builtins_CEntry_Return1_ArgvOnStack_BuiltinExit + 54
    frame #109: 0x00000000018a258f <constructor>
    frame #110: 0x00000000019eefc2 <stub>
    frame #111: 0x00000000018a4d1c <non-function>
    frame #112: 0x00000000018a2402 <constructor>
    frame #113: 0x00000000019eefc2 <stub>
    frame #114: 0x00000000018a4d1c _moduleCompile(this=0x362c8ec04181:<Object: no constructor>, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x1b5004701149:<String: ""use strict";
va...">, 0x1b3f221404e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN8-BI/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:200:17 fn=0x0000362c8ec04149
    frame #115: 0x00000000018a4d1c Module._compile(this=0x362c8ec042e1:<Object: Module>, 0x1b5004701149:<String: ""use strict";
va...">, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN8-BI/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:155:41 fn=0x000001ce4dcc42f1
    frame #116: 0x00000000018a4d1c Module._extensions..js(this=0x1aada43982c1:<Object: Object>, 0x362c8ec042e1:<Object: Module>, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x26af69f1d0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398429
    frame #117: 0x00000000018a4d1c Module.load(this=0x362c8ec042e1:<Object: Module>, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398f49
    frame #118: 0x00000000018a4d1c Module._load(this=0x1aada4398071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x4ef4199bc61:<String: "../dist/pnpm.cjs">, 0x362c8ec04389:<Object: Module>, 0x1b3f221406b9:<false>, 0x1b3f221406b9:<false>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398a71
    frame #119: 0x00000000018a4d1c Module.require(this=0x362c8ec04389:<Object: Module>, 0x4ef4199bc61:<String: "../dist/pnpm.cjs">, 0x362c8ec04389:<Object: Module>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398fa1
    frame #120: 0x00000000018a4d1c require(this=0x1b3f221404e9:<undefined>, 0x4ef4199bc61:<String: "../dist/pnpm.cjs">, 0x1b3f221404e9:<undefined>) at node:internal/modules/helpers:1:10 fn=0x0000362c8ec04411
    frame #121: 0x00000000018a4d1c (this=0x362c8ec044c1:<Object: Object>, 0x362c8ec044c1:<Object: Object>, 0x362c8ec04411:<function: require at node:internal/modules/helpers:1:10>, 0x362c8ec04389:<Object: Module>, 0x4ef419970c9:<String: "/home/bamboo/bam...">, 0x362c8ec044f9:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN8-BI/node_modules/.pnpm/pnpm@8.9.0/node_modules/pnpm/bin/pnpm.cjs:1:0 fn=0x0000362c8ec04481
    frame #122: 0x00000000018a4d1c Module._compile(this=0x362c8ec04389:<Object: Module>, 0x362c8ec04539:<String: "#!/usr/bin/env n...">, 0x4ef419970c9:<String: "/home/bamboo/bam...">,
 0x1b3f221404e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398ed9
    frame #123: 0x00000000018a4d1c Module._extensions..js(this=0x1aada43982c1:<Object: Object>, 0x362c8ec04389:<Object: Module>, 0x4ef419970c9:<String: "/home/bamboo/bam...">, 0x26af69f1d0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398429
    frame #124: 0x00000000018a4d1c Module.load(this=0x362c8ec04389:<Object: Module>, 0x4ef419970c9:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398f49
    frame #125: 0x00000000018a4d1c Module._load(this=0x1aada4398071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x362c8ec04951:<String: "/home/bamboo/bam...">, 0x1b3f22140269:<null>, 0x1b3f22140659:<true>, 0x1b3f22140659:<true>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398a71
    frame #126: 0x00000000018a4d1c executeUserEntryPoint(this=0x1aada4398071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x362c8ec04951:<String: "/home/bamboo/bam...">, 0x26af69f3af61:<String: "internal/modules...">) at node:internal/modules/run_main:1:10 fn=0x000002a7e6a2e501
    frame #127: 0x00000000018a4d1c (this=0x1b3f221404e9:<undefined>, 0x1aada4383851:<Object: process>, 0x26af69f1ed81:<function: requireBuiltin at node:internal/bootstrap/realm:1:10>, 0x26af69f1edd9:<function: internalBinding at node:internal/bootstrap/realm:1:10>, 0x1aada4389aa1:<Object: Object>, 0x362c8ec04a61:<function:  at node:internal/main/run_main_module:1:0>) at node:internal/main/run_main_module:1:0 fn=0x0000362c8ec04a61
    frame #128: 0x00000000018a30dc <internal>
    frame #129: 0x00000000018a2e03 <entry>
    frame #130: 0x000000000102cd5b node-debug`v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) + 299
    frame #131: 0x000000000102ddfc node-debug`v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*) + 108
    frame #132: 0x0000000000eef9ea node-debug`v8::Function::Call(v8::Local<v8::Context>, v8::Local<v8::Value>, int, v8::Local<v8::Value>*) + 330
    frame #133: 0x0000000000c8bfef node-debug`node::builtins::BuiltinLoader::CompileAndCall(v8::Local<v8::Context>, char const*, node::Realm*) + 255
    frame #134: 0x0000000000d3f6c0 node-debug`node::Realm::ExecuteBootstrapper(char const*) + 80
    frame #135: 0x0000000000c6217d node-debug`node::StartExecution(node::Environment*, char const*) + 45
    frame #136: 0x0000000000c643b5 node-debug`node::StartExecution(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 2885
    frame #137: 0x0000000000bc7672 node-debug`node::LoadEnvironment(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 98
    frame #138: 0x0000000000cffc27 node-debug`node::NodeMainInstance::Run(node::ExitCode*, node::Environment*) (.part.0) + 87
    frame #139: 0x0000000000d0061d node-debug`node::NodeMainInstance::Run() + 205
    frame #140: 0x0000000000c68162 node-debug`node::Start(int, char**) + 1474

core dump 2 has the following stack trace:

 * thread #1: tid = 536208, 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14, name = 'node', stop reason = signal SIGTRAP
  * frame #0: 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14
    frame #1: 0x000000000210ea92 node-debug`V8_Fatal(char const*, ...) + 354
    frame #2: 0x000000000153838c node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 1820
    frame #3: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #4: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #5: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #6: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #7: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #8: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #9: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #10: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
    frame #11: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #12: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #13: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #14: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #15: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #16: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #17: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #18: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #19: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #20: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #21: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #22: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #23: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
    frame #24: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
    frame #25: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
    frame #26: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
    frame #27: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
    frame #28: 0x000000000153d1c2 node-debug`v8::internal::ObjectDeserializer::Deserialize() + 50
    frame #29: 0x000000000153d3d4 node-debug`v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) + 132
    frame #30: 0x000000000152fff2 node-debug`v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) + 626
    frame #31: 0x0000000000f969eb node-debug`v8::internal::(anonymous namespace)::GetSharedFunctionInfoForScriptImpl(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::Extension*, v8::internal::AlignedCachedData*, v8::internal::BackgroundDeserializeTask*, bool (*)(int, void*), void*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) (.constprop.0) + 4091
    frame #32: 0x0000000000f96ccd node-debug`v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) + 29
    frame #33: 0x0000000000ef5b0f node-debug`v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) (.part.0) + 1343
    frame #34: 0x0000000000ef5c28 node-debug`v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) + 72
    frame #35: 0x0000000000c9cd8d node-debug`node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) + 1885
    frame #36: 0x0000000000f3451e node-debug`v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) + 318
    frame #37: 0x0000000000f34ad2 node-debug`v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<true>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, unsigned long*, int) + 274
    frame #38: 0x0000000000f351e3 node-debug`v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) + 179
    frame #39: 0x00000000019331b6 node-debug`Builtins_CEntry_Return1_ArgvOnStack_BuiltinExit + 54
    frame #40: 0x00000000018a258f <constructor>
    frame #41: 0x00000000019eefc2 <stub>
    frame #42: 0x00000000018a4d1c <non-function>
    frame #43: 0x00000000018a2402 <constructor>
    frame #44: 0x00000000019eefc2 <stub>
    frame #45: 0x00000000018a4d1c _moduleCompile(this=0x23ca55804181:<Object: no constructor>, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x3ce2fe141149:<String: ""use strict";
va...">, 0x288e8b5c04e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:200:17 fn=0x000023ca55804149
    frame #46: 0x00000000018a4d1c Module._compile(this=0x23ca558042e1:<Object: Module>, 0x3ce2fe141149:<String: ""use strict";
va...">, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:155:41 fn=0x00002e4938d446c1
    frame #47: 0x00000000018a4d1c Module._extensions..js(this=0x390cbf0582c1:<Object: Object>, 0x23ca558042e1:<Object: Module>, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x341fd72dd0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058429
    frame #48: 0x00000000018a4d1c Module.load(this=0x23ca558042e1:<Object: Module>, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058f49
    frame #49: 0x00000000018a4d1c Module._load(this=0x390cbf058071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x2dacad49bc61:<String: "../dist/pnpm.cjs">, 0x23ca55804389:<Object: Module>, 0x288e8b5c06b9:<false>, 0x288e8b5c06b9:<false>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058a71
    frame #50: 0x00000000018a4d1c Module.require(this=0x23ca55804389:<Object: Module>, 0x2dacad49bc61:<String: "../dist/pnpm.cjs">, 0x23ca55804389:<Object: Module>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058fa1
    frame #51: 0x00000000018a4d1c require(this=0x288e8b5c04e9:<undefined>, 0x2dacad49bc61:<String: "../dist/pnpm.cjs">, 0x288e8b5c04e9:<undefined>) at node:internal/modules/helpers:1:10 fn=0x000023ca55804411
    frame #52: 0x00000000018a4d1c (this=0x23ca558044c1:<Object: Object>, 0x23ca558044c1:<Object: Object>, 0x23ca55804411:<function: require at node:internal/modules/helpers:1:10>, 0x23ca55804389:<Object: Module>, 0x2dacad4970c9:<String: "/home/bamboo/bam...">, 0x23ca558044f9:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/pnpm@8.9.0/node_modules/pnpm/bin/pnpm.cjs:1:0 fn=0x000023ca55804481
    frame #53: 0x00000000018a4d1c Module._compile(this=0x23ca55804389:<Object: Module>, 0x23ca55804539:<String: "#!/usr/bin/env n...">, 0x2dacad4970c9:<String: "/home/bamboo/bam...">,
 0x288e8b5c04e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058ed9
    frame #54: 0x00000000018a4d1c Module._extensions..js(this=0x390cbf0582c1:<Object: Object>, 0x23ca55804389:<Object: Module>, 0x2dacad4970c9:<String: "/home/bamboo/bam...">, 0x341fd72dd0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058429
    frame #55: 0x00000000018a4d1c Module.load(this=0x23ca55804389:<Object: Module>, 0x2dacad4970c9:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058f49
    frame #56: 0x00000000018a4d1c Module._load(this=0x390cbf058071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x23ca55804951:<String: "/home/bamboo/bam...">, 0x288e8b5c0269:<null>, 0x288e8b5c0659:<true>, 0x288e8b5c0659:<true>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058a71
    frame #57: 0x00000000018a4d1c executeUserEntryPoint(this=0x390cbf058071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x23ca55804951:<String: "/home/bamboo/bam...">, 0x341fd72faf61:<String: "internal/modules...">) at node:internal/modules/run_main:1:10 fn=0x00001903ceaae501
    frame #58: 0x00000000018a4d1c (this=0x288e8b5c04e9:<undefined>, 0x390cbf043851:<Object: process>, 0x341fd72ded81:<function: requireBuiltin at node:internal/bootstrap/realm:1:10>, 0x341fd72dedd9:<function: internalBinding at node:internal/bootstrap/realm:1:10>, 0x390cbf049aa1:<Object: Object>, 0x23ca55804a61:<function:  at node:internal/main/run_main_module:1:0>) at node:internal/main/run_main_module:1:0 fn=0x000023ca55804a61
    frame #59: 0x00000000018a30dc <internal>
    frame #60: 0x00000000018a2e03 <entry>
    frame #61: 0x000000000102cd5b node-debug`v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) + 299
    frame #62: 0x000000000102ddfc node-debug`v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*) + 108
    frame #63: 0x0000000000eef9ea node-debug`v8::Function::Call(v8::Local<v8::Context>, v8::Local<v8::Value>, int, v8::Local<v8::Value>*) + 330
    frame #64: 0x0000000000c8bfef node-debug`node::builtins::BuiltinLoader::CompileAndCall(v8::Local<v8::Context>, char const*, node::Realm*) + 255
    frame #65: 0x0000000000d3f6c0 node-debug`node::Realm::ExecuteBootstrapper(char const*) + 80
    frame #66: 0x0000000000c6217d node-debug`node::StartExecution(node::Environment*, char const*) + 45
    frame #67: 0x0000000000c643b5 node-debug`node::StartExecution(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 2885
    frame #68: 0x0000000000bc7672 node-debug`node::LoadEnvironment(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 98
    frame #69: 0x0000000000cffc27 node-debug`node::NodeMainInstance::Run(node::ExitCode*, node::Environment*) (.part.0) + 87
    frame #70: 0x0000000000d0061d node-debug`node::NodeMainInstance::Run() + 205
    frame #71: 0x0000000000c68162 node-debug`node::Start(int, char**) + 1474

It looks like the last JS function is _moduleCompile in v8-compile-cache (https://github.com/zertosh/v8-compile-cache/blob/v2.3.0/v8-compile-cache.js#L200)

I inspected the two parameters for this function:

For both core dumps, the values of these variables are the same. Let me know if anything else is required.

Thanks!

rmlevangelio commented 5 months ago

We tried settingDISABLE_V8_COMPILE_CACHE =1 in our yaml files and it still crashing the builds.

zxkane commented 3 months ago

From some quick search, it seems pnpm is using v8-compile-cache: https://github.com/search?q=repo%3Apnpm%2Fpnpm%20v8-compile-cache&type=code

And yarn seems to use that too, though I am not able to find where the code is: yarnpkg/berry#5987

I noticed that v8-compile-cache only invalidates the cache when the content of the file changes and doesn't seem to do anything if the V8 version/Node.js version mismatches with the cache. That could be a source of bug like this. If DISABLE_V8_COMPILE_CACHE =1 makes the crash go away, then the crash would be introduced by this package.

It works as workaround in my project. The use case is that the project has lots of AWS Lambda functions written in TS; the intermittent crash happened when parallelly using esbuild to bundle those functions in jest tests.

bradzacher commented 1 month ago

We've started to see this crash in our CI agents at Canva. We recently switched to a setup for our ESLint runs where we run ~30 node instances in parallel and we've started intermittently seeing the following crash occur (which is similar to the one listed in the above comment)

#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7fffe32777b0
----- Native stack trace -----

 1: 0xc7e785  [node]
 2: 0x1aef18a V8_Fatal(char const*, ...) [node]
 3: 0x14b6c8c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
 4: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 5: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
 6: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 7: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
 8: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
 9: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
10: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
11: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
12: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
13: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
14: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
16: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
17: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
18: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
19: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
20: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
22: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
23: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
24: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
25: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
26: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
28: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
29: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
30: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
31: 0x14b889c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
32: 0x14b9290 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
33: 0x14bec06 v8::internal::ObjectDeserializer::Deserialize() [node]
34: 0x14bedef v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
35: 0x14b02de v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
36: 0xf0b841  [node]
37: 0xf0bb6d v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
38: 0xe550f8 v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
39: 0xbd8ac1 node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
40: 0xea0812 v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
41: 0xea12de  [node]
42: 0xea1590 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
43: 0x18a4df6  [node]

It's worth noting that this is the first time we've seen this crash - we run node across most of our CI and we don't see such crashes elsewhere - it's just been since we switched to hyper-parallelising on one machine.

Note:

I'm still investigating to try and repro or refine the cause - but just posting because it does seem related.

anonrig commented 1 month ago

I suspect node::contextify::ContextifyScript might be the root cause of this

bradzacher commented 1 month ago

We run ~30 node instances simultaneously per eslint CI run and we do a few thousand CI runs per day (i.e. >30k node invocations per day for this new job), but this crash has only occurred about 3 times in the last week. It's very difficult to pin down.

Update - turns out our engineers were just treating it as a flake and retrying without telling us - it's occurring quite frequently across our runs. I don't have an exact number of how often but it's enough that I'll have to figure out an auto-retry workaround for now.

I haven't had any luck with a reproduction though 😢

joyeecheung commented 1 month ago

I suspect node::contextify::ContextifyScript might be the root cause of this

The root cause was likely incorrect cache usage by a user land package or corrupted cache provided by user land package. node::contextify::ContextifyScript is only the API that these packages tend to use to load code cache (typically coupled with monkey patching CJS loader), like what v8-compile-cache does, which was why DISABLE_V8_COMPILE_CACHE =1 works for some people being affected by that package (this is not a Node.js configuration, just a configuration of that npm package). But that’s not the only package that does this and if you have another package in your dependency that does this, you’d need to find what it as and what workaround it has.

I am not sure what else we can do in this repository given that from the stack trace it seems to be mostly caused by bugs in third-party packages (Node.js internally only use node::contextify::ContextifyScript in a few places that are unlikely to be related to this e.g. in the REPL). By default CJS modules are not compiled in this path, it’s usually used by third-party packages monkey patching the CJS loader.

bradzacher commented 1 month ago

We're generally very careful to avoid v8-compile-cache in our code because it can cause issues and I had to look hard to find it. We have some of our ESLint config logic written in .ts and then the eslint config file uses ts-node to strip the types at runtime and ts-node uses v8-compile-cache-lib under-the-hood.

I'll try DISABLE_V8_COMPILE_CACHE=1 and see how it goes!

bradzacher commented 1 week ago

Update: It's been a few weeks and it looks like DISABLE_V8_COMPILE_CACHE=1 did indeed fix the issue in our infra