Open tomdee opened 7 months ago
We are seeing similar issues with Node.js 20 on Sentry javascript sdk repository. I couldn't find a repro as well. @joyeecheung Any suggestions?
Without a repro it's hard to tell what's going on here. From the stack trace it could be a V8 bug.
By the way if a core dump is available that would make it easier to get to clues about what was happening.
Hello!
I'm currently facing what seems to be the same issue in CI. This occurs on Node 20 (specifically, 20.8.0, 20.10.0, 20.11.0). Our build workers run on Amazon Linux 2023 and we build with 4 parallel processes with Nx.
I did retireve core dumps of these crashes, unfortunately I'm unable to provide them, but I can provide the stack traces from gdb.
This crash:
#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7fff4862fc50
----- Native stack trace -----
1: 0xd2a6e1 [node]
2: 0x210ea81 V8_Fatal(char const*, ...) [node]
3: 0x153838c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
4: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
5: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
6: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
7: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
8: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
9: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
10: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
11: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
12: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
13: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
14: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
16: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
17: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
18: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
19: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
20: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
22: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
23: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
24: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
25: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
26: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
28: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
29: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
30: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
31: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
32: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
33: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
34: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
35: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
36: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
37: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
38: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
39: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
40: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
41: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
42: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
43: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
44: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
45: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
46: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
47: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
48: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
49: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
50: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
51: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
52: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
53: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
54: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
55: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
56: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
57: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
58: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
59: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
60: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
61: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
62: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
63: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
64: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
65: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
66: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
67: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
68: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
69: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
70: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
71: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
72: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
73: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
74: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
75: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
76: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
77: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
78: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
79: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
80: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
81: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
82: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
83: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
84: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
85: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
86: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
87: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
88: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
89: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
90: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
91: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
92: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
93: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
94: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
95: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
96: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
97: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
98: 0x153d1c2 v8::internal::ObjectDeserializer::Deserialize() [node]
99: 0x153d3d4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
100: 0x152fff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
101: 0xf969eb [node]
102: 0xf96ccd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
103: 0xef5b0f [node]
104: 0xef5c28 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
105: 0xc9cd8d node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
106: 0xf3451e v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
107: 0xf34ad2 [node]
108: 0xf351e3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
109: 0x19331b6 [node]
Has the following stack trace in gdb:
#0 0x000000000211b0fe in v8::internal::MemCopy (size=<error reading variable: Cannot access memory at address 0x48>, src=0x0, dest=0x7f11409fba40) at ../deps/v8/src/utils/memcopy.h:91
#1 v8::internal::RegExpBytecodeGenerator::Copy (a=0x7f11409fba40 "", this=0x0) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:397
#2 v8::internal::RegExpBytecodeGenerator::GetCode (this=0x0, source=...) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:388
#3 0x00007fff4862ff30 in ?? ()
#4 0x00007fff4862fe60 in ?? ()
#5 0x00000000decade10 in ?? ()
#6 0x6168636165726e75 in ?? ()
#7 0x65646f6320656c62 in ?? ()
#8 0x0000000000000000 in ?? ()
And this crash:
#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7ffdb38fb680
----- Native stack trace -----
1: 0xd2a6e1 [node]
2: 0x210ea81 V8_Fatal(char const*, ...) [node]
3: 0x153838c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
4: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
5: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
6: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
7: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
8: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
9: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
10: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
11: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
12: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
13: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
14: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
16: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
17: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
18: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
19: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
20: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
22: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
23: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
24: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
25: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
26: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
28: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
29: 0x153d1c2 v8::internal::ObjectDeserializer::Deserialize() [node]
30: 0x153d3d4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
31: 0x152fff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
32: 0xf969eb [node]
33: 0xf96ccd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
34: 0xef5b0f [node]
35: 0xef5c28 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
36: 0xc9cd8d node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
37: 0xf3451e v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
38: 0xf34ad2 [node]
39: 0xf351e3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
40: 0x19331b6 [node]
NX Command failed: pnpm --version
#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7ffdb38fb680
----- Native stack trace -----
1: 0xd2a6e1 [node]
2: 0x210ea81 V8_Fatal(char const*, ...) [node]
3: 0x153838c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
4: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
5: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
6: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
7: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
8: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
9: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
10: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
11: 0x1537986 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
12: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
13: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
14: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
16: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
17: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
18: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
19: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
20: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
22: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
23: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
24: 0x1536875 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
25: 0x1537791 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
26: 0x1537a5a v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x1537d3b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
28: 0x153861f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
29: 0x153d1c2 v8::internal::ObjectDeserializer::Deserialize() [node]
30: 0x153d3d4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
31: 0x152fff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
32: 0xf969eb [node]
33: 0xf96ccd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
34: 0xef5b0f [node]
35: 0xef5c28 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
36: 0xc9cd8d node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
37: 0xf3451e v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
38: 0xf34ad2 [node]
39: 0xf351e3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
40: 0x19331b6 [node]
With the following stack trace in gdb:
#0 0x000000000211b0fe in v8::internal::MemCopy (size=<error reading variable: Cannot access memory at address 0x48>, src=0x0, dest=0x7f1e595fba40) at ../deps/v8/src/utils/memcopy.h:91
#1 v8::internal::RegExpBytecodeGenerator::Copy (a=0x7f1e595fba40 "", this=0x0) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:397
#2 v8::internal::RegExpBytecodeGenerator::GetCode (this=0x0, source=...) at ../deps/v8/src/regexp/regexp-bytecode-generator.cc:388
#3 0x00007ffdb38fb960 in ?? ()
#4 0x00007ffdb38fb890 in ?? ()
#5 0x00000000decade10 in ?? ()
#6 0x6168636165726e75 in ?? ()
#7 0x65646f6320656c62 in ?? ()
#8 0x0000000000000000 in ?? ()
Ocassionally the following error will occur as well:
#
# Fatal error in , line 0
# Check failed: current == end_slot_index.
#
#
#
#FailureMessage Object: 0x7fff93f1da60
1: 0xd15331 [node]
2: 0x20ef531 V8_Fatal(char const*, ...) [node]
3: 0x1535691 [node]
4: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
5: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
6: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
7: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
8: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
9: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
10: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
11: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
12: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
13: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
14: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
15: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
16: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
17: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
18: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
19: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
20: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
21: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
22: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
23: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
24: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
25: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
26: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
27: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
28: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
29: 0x153452b int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
30: 0x1535661 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [node]
31: 0x1535928 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
32: 0x1535c09 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
33: 0x153650f v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
34: 0x153b0a2 v8::internal::ObjectDeserializer::Deserialize() [node]
35: 0x153b2b4 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
36: 0x152dff2 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
37: 0xf8871b [node]
38: 0xf889fd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
39: 0xee877c [node]
40: 0xee8888 v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
41: 0xc8817e node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
42: 0xf268ff v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
43: 0xf26eb5 [node]
44: 0xf275d3 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
45: 0x1930df6 [node]
However I have been unable to collect a core dump of this error occuring.
Interestingly, these errors typically coincide with Nx printing: NX Command failed: pnpm --version
. Not sure how that could correlate.
Hopefully this can help with this issue.
Thanks!
IIUC this and OP were both running into issues in a similar setup in https://github.com/actions/setup-node/issues/887 (with GitHub actions)?
From the OP of that issue, I suspect the caching GitHub does could interact poorly with a user land dependency that makes use of vm.Script. It can also be possible that this dependency is monkey patching the builtin CJS loader to compile data with code cache, and for some reason, the cache it uses is mismatching the version of Node.js in the CI, which is why in the other issue, OP reports that they were seeing wrong Node.js versions. AFAIK, one such popular package that does this is https://www.npmjs.com/package/v8-compile-cache - does this package show up in your dependency? If it does, does setting DISABLE_V8_COMPILE_CACHE=1 make the crash go away?
Also, I am not sure if it still works on v20, but can you try using LLDB and https://github.com/nodejs/llnode to see if you can print the JS stack trace (the command is "v8 bt" with the plugin) from the core dump? The stack traces indicates that this crash comes from user land JS code, so that would help us pinpoint what JS code (likely a third party package) is causing the crash.
From some quick search, it seems pnpm is using v8-compile-cache: https://github.com/search?q=repo%3Apnpm%2Fpnpm%20v8-compile-cache&type=code
And yarn seems to use that too, though I am not able to find where the code is: https://github.com/yarnpkg/berry/issues/5987
I noticed that v8-compile-cache only invalidates the cache when the content of the file changes and doesn't seem to do anything if the V8 version/Node.js version mismatches with the cache. That could be a source of bug like this. If DISABLE_V8_COMPILE_CACHE =1
makes the crash go away, then the crash would be introduced by this package.
Thank you for investigating this!
IIUC this and OP were both running into issues in a similar setup in https://github.com/actions/setup-node/issues/887 (with GitHub actions)?
I'm running into the same issue, but not with Github actions. I'm running into this issue with an Atlasssian Bamboo elastic build agent. This is occurring on a standard AWS EC2 instance, running Amazon Linux. Additionally, I've tested multiple Node 20 versions. Interestingly, this crash does not seem to occur on Windows. We have a project within the same monorepo that is built on Windows. As a result, pnpm and Nx are used there as well.
Also, I am not sure if it still works on v20, but can you try using LLDB and https://github.com/nodejs/llnode to see if you can print the JS stack trace
I'll give this a try and report back
If DISABLE_V8_COMPILE_CACHE =1 makes the crash go away, then the crash would be introduced by this package.
I will also give this a try and report back!
Thank you!
I set DISABLE_V8_COMPILE_CACHE=1
and I can confirm it seems to prevent these crashes for me. I have had 10/10 successful builds without any nodejs crashes. Before I was experiencing about a 3/10 success rate.
Also, it appears llnode still works with Node 20 :D. It also seems lldb
prints a vastly different stack trace, compared to gdb.
core dump 1 has the follow stack trace:
* thread #1: tid = 511004, 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14, name = 'node', stop reason = signal SIGTRAP
* frame #0: 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14
frame #1: 0x000000000210ea92 node-debug`V8_Fatal(char const*, ...) + 354
frame #2: 0x000000000153838c node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 1820
frame #3: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #4: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #5: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #6: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #7: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #8: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #9: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #10: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #11: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #12: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #13: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #14: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #15: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #16: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #17: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #18: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #19: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #20: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #21: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #22: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #23: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #24: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #25: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #26: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #27: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #28: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #29: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #30: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #31: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #32: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #33: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #34: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #35: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #36: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #37: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #38: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #39: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #40: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #41: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #42: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #43: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #44: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #45: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #46: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #47: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #48: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #49: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #50: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #51: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #52: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #53: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #54: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #55: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #56: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #57: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #58: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #59: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #60: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #61: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #62: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #63: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #64: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #65: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #66: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #67: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #68: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #69: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #70: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #71: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #72: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #73: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #74: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #75: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #76: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #77: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #78: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #79: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #80: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #81: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #82: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #83: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #84: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #85: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #86: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #87: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #88: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #89: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #90: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #91: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #92: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #93: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #94: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #95: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #96: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #97: 0x000000000153d1c2 node-debug`v8::internal::ObjectDeserializer::Deserialize() + 50
frame #98: 0x000000000153d3d4 node-debug`v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) + 132
frame #99: 0x000000000152fff2 node-debug`v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) + 626
frame #100: 0x0000000000f969eb node-debug`v8::internal::(anonymous namespace)::GetSharedFunctionInfoForScriptImpl(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::Extension*, v8::internal::AlignedCachedData*, v8::internal::BackgroundDeserializeTask*, bool (*)(int, void*), void*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) (.constprop.0) + 4091
frame #101: 0x0000000000f96ccd node-debug`v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) + 29
frame #102: 0x0000000000ef5b0f node-debug`v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) (.part.0) + 1343
frame #103: 0x0000000000ef5c28 node-debug`v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) + 72
frame #104: 0x0000000000c9cd8d node-debug`node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) + 1885
frame #105: 0x0000000000f3451e node-debug`v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) + 318
frame #106: 0x0000000000f34ad2 node-debug`v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<true>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, unsigned long*, int) + 274
frame #107: 0x0000000000f351e3 node-debug`v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) + 179
frame #108: 0x00000000019331b6 node-debug`Builtins_CEntry_Return1_ArgvOnStack_BuiltinExit + 54
frame #109: 0x00000000018a258f <constructor>
frame #110: 0x00000000019eefc2 <stub>
frame #111: 0x00000000018a4d1c <non-function>
frame #112: 0x00000000018a2402 <constructor>
frame #113: 0x00000000019eefc2 <stub>
frame #114: 0x00000000018a4d1c _moduleCompile(this=0x362c8ec04181:<Object: no constructor>, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x1b5004701149:<String: ""use strict";
va...">, 0x1b3f221404e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN8-BI/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:200:17 fn=0x0000362c8ec04149
frame #115: 0x00000000018a4d1c Module._compile(this=0x362c8ec042e1:<Object: Module>, 0x1b5004701149:<String: ""use strict";
va...">, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN8-BI/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:155:41 fn=0x000001ce4dcc42f1
frame #116: 0x00000000018a4d1c Module._extensions..js(this=0x1aada43982c1:<Object: Object>, 0x362c8ec042e1:<Object: Module>, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x26af69f1d0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398429
frame #117: 0x00000000018a4d1c Module.load(this=0x362c8ec042e1:<Object: Module>, 0x1ce4dcc3461:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398f49
frame #118: 0x00000000018a4d1c Module._load(this=0x1aada4398071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x4ef4199bc61:<String: "../dist/pnpm.cjs">, 0x362c8ec04389:<Object: Module>, 0x1b3f221406b9:<false>, 0x1b3f221406b9:<false>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398a71
frame #119: 0x00000000018a4d1c Module.require(this=0x362c8ec04389:<Object: Module>, 0x4ef4199bc61:<String: "../dist/pnpm.cjs">, 0x362c8ec04389:<Object: Module>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398fa1
frame #120: 0x00000000018a4d1c require(this=0x1b3f221404e9:<undefined>, 0x4ef4199bc61:<String: "../dist/pnpm.cjs">, 0x1b3f221404e9:<undefined>) at node:internal/modules/helpers:1:10 fn=0x0000362c8ec04411
frame #121: 0x00000000018a4d1c (this=0x362c8ec044c1:<Object: Object>, 0x362c8ec044c1:<Object: Object>, 0x362c8ec04411:<function: require at node:internal/modules/helpers:1:10>, 0x362c8ec04389:<Object: Module>, 0x4ef419970c9:<String: "/home/bamboo/bam...">, 0x362c8ec044f9:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN8-BI/node_modules/.pnpm/pnpm@8.9.0/node_modules/pnpm/bin/pnpm.cjs:1:0 fn=0x0000362c8ec04481
frame #122: 0x00000000018a4d1c Module._compile(this=0x362c8ec04389:<Object: Module>, 0x362c8ec04539:<String: "#!/usr/bin/env n...">, 0x4ef419970c9:<String: "/home/bamboo/bam...">,
0x1b3f221404e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398ed9
frame #123: 0x00000000018a4d1c Module._extensions..js(this=0x1aada43982c1:<Object: Object>, 0x362c8ec04389:<Object: Module>, 0x4ef419970c9:<String: "/home/bamboo/bam...">, 0x26af69f1d0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398429
frame #124: 0x00000000018a4d1c Module.load(this=0x362c8ec04389:<Object: Module>, 0x4ef419970c9:<String: "/home/bamboo/bam...">, 0x1b3f221404e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398f49
frame #125: 0x00000000018a4d1c Module._load(this=0x1aada4398071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x362c8ec04951:<String: "/home/bamboo/bam...">, 0x1b3f22140269:<null>, 0x1b3f22140659:<true>, 0x1b3f22140659:<true>) at node:internal/modules/cjs/loader:1:10 fn=0x00001aada4398a71
frame #126: 0x00000000018a4d1c executeUserEntryPoint(this=0x1aada4398071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x362c8ec04951:<String: "/home/bamboo/bam...">, 0x26af69f3af61:<String: "internal/modules...">) at node:internal/modules/run_main:1:10 fn=0x000002a7e6a2e501
frame #127: 0x00000000018a4d1c (this=0x1b3f221404e9:<undefined>, 0x1aada4383851:<Object: process>, 0x26af69f1ed81:<function: requireBuiltin at node:internal/bootstrap/realm:1:10>, 0x26af69f1edd9:<function: internalBinding at node:internal/bootstrap/realm:1:10>, 0x1aada4389aa1:<Object: Object>, 0x362c8ec04a61:<function: at node:internal/main/run_main_module:1:0>) at node:internal/main/run_main_module:1:0 fn=0x0000362c8ec04a61
frame #128: 0x00000000018a30dc <internal>
frame #129: 0x00000000018a2e03 <entry>
frame #130: 0x000000000102cd5b node-debug`v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) + 299
frame #131: 0x000000000102ddfc node-debug`v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*) + 108
frame #132: 0x0000000000eef9ea node-debug`v8::Function::Call(v8::Local<v8::Context>, v8::Local<v8::Value>, int, v8::Local<v8::Value>*) + 330
frame #133: 0x0000000000c8bfef node-debug`node::builtins::BuiltinLoader::CompileAndCall(v8::Local<v8::Context>, char const*, node::Realm*) + 255
frame #134: 0x0000000000d3f6c0 node-debug`node::Realm::ExecuteBootstrapper(char const*) + 80
frame #135: 0x0000000000c6217d node-debug`node::StartExecution(node::Environment*, char const*) + 45
frame #136: 0x0000000000c643b5 node-debug`node::StartExecution(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 2885
frame #137: 0x0000000000bc7672 node-debug`node::LoadEnvironment(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 98
frame #138: 0x0000000000cffc27 node-debug`node::NodeMainInstance::Run(node::ExitCode*, node::Environment*) (.part.0) + 87
frame #139: 0x0000000000d0061d node-debug`node::NodeMainInstance::Run() + 205
frame #140: 0x0000000000c68162 node-debug`node::Start(int, char**) + 1474
core dump 2 has the following stack trace:
* thread #1: tid = 536208, 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14, name = 'node', stop reason = signal SIGTRAP
* frame #0: 0x000000000211b0fe node-debug`v8::base::OS::Abort() + 14
frame #1: 0x000000000210ea92 node-debug`V8_Fatal(char const*, ...) + 354
frame #2: 0x000000000153838c node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 1820
frame #3: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #4: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #5: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #6: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #7: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #8: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #9: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #10: 0x0000000001537986 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 118
frame #11: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #12: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #13: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #14: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #15: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #16: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #17: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #18: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #19: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #20: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #21: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #22: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #23: 0x0000000001536875 node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) + 1157
frame #24: 0x0000000001537791 node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) + 97
frame #25: 0x0000000001537a5a node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) + 330
frame #26: 0x0000000001537d3b node-debug`int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate>>(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) + 203
frame #27: 0x000000000153861f node-debug`v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() + 47
frame #28: 0x000000000153d1c2 node-debug`v8::internal::ObjectDeserializer::Deserialize() + 50
frame #29: 0x000000000153d3d4 node-debug`v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) + 132
frame #30: 0x000000000152fff2 node-debug`v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) + 626
frame #31: 0x0000000000f969eb node-debug`v8::internal::(anonymous namespace)::GetSharedFunctionInfoForScriptImpl(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::Extension*, v8::internal::AlignedCachedData*, v8::internal::BackgroundDeserializeTask*, bool (*)(int, void*), void*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) (.constprop.0) + 4091
frame #32: 0x0000000000f96ccd node-debug`v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) + 29
frame #33: 0x0000000000ef5b0f node-debug`v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) (.part.0) + 1343
frame #34: 0x0000000000ef5c28 node-debug`v8::ScriptCompiler::CompileUnboundScript(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) + 72
frame #35: 0x0000000000c9cd8d node-debug`node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) + 1885
frame #36: 0x0000000000f3451e node-debug`v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) + 318
frame #37: 0x0000000000f34ad2 node-debug`v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<true>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, unsigned long*, int) + 274
frame #38: 0x0000000000f351e3 node-debug`v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) + 179
frame #39: 0x00000000019331b6 node-debug`Builtins_CEntry_Return1_ArgvOnStack_BuiltinExit + 54
frame #40: 0x00000000018a258f <constructor>
frame #41: 0x00000000019eefc2 <stub>
frame #42: 0x00000000018a4d1c <non-function>
frame #43: 0x00000000018a2402 <constructor>
frame #44: 0x00000000019eefc2 <stub>
frame #45: 0x00000000018a4d1c _moduleCompile(this=0x23ca55804181:<Object: no constructor>, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x3ce2fe141149:<String: ""use strict";
va...">, 0x288e8b5c04e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:200:17 fn=0x000023ca55804149
frame #46: 0x00000000018a4d1c Module._compile(this=0x23ca558042e1:<Object: Module>, 0x3ce2fe141149:<String: ""use strict";
va...">, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/v8-compile-cache@2.3.0/node_modules/v8-compile-cache/v8-compile-cache.js:155:41 fn=0x00002e4938d446c1
frame #47: 0x00000000018a4d1c Module._extensions..js(this=0x390cbf0582c1:<Object: Object>, 0x23ca558042e1:<Object: Module>, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x341fd72dd0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058429
frame #48: 0x00000000018a4d1c Module.load(this=0x23ca558042e1:<Object: Module>, 0x2e4938d43831:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058f49
frame #49: 0x00000000018a4d1c Module._load(this=0x390cbf058071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x2dacad49bc61:<String: "../dist/pnpm.cjs">, 0x23ca55804389:<Object: Module>, 0x288e8b5c06b9:<false>, 0x288e8b5c06b9:<false>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058a71
frame #50: 0x00000000018a4d1c Module.require(this=0x23ca55804389:<Object: Module>, 0x2dacad49bc61:<String: "../dist/pnpm.cjs">, 0x23ca55804389:<Object: Module>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058fa1
frame #51: 0x00000000018a4d1c require(this=0x288e8b5c04e9:<undefined>, 0x2dacad49bc61:<String: "../dist/pnpm.cjs">, 0x288e8b5c04e9:<undefined>) at node:internal/modules/helpers:1:10 fn=0x000023ca55804411
frame #52: 0x00000000018a4d1c (this=0x23ca558044c1:<Object: Object>, 0x23ca558044c1:<Object: Object>, 0x23ca55804411:<function: require at node:internal/modules/helpers:1:10>, 0x23ca55804389:<Object: Module>, 0x2dacad4970c9:<String: "/home/bamboo/bam...">, 0x23ca558044f9:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at /home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/pnpm@8.9.0/node_modules/pnpm/bin/pnpm.cjs:1:0 fn=0x000023ca55804481
frame #53: 0x00000000018a4d1c Module._compile(this=0x23ca55804389:<Object: Module>, 0x23ca55804539:<String: "#!/usr/bin/env n...">, 0x2dacad4970c9:<String: "/home/bamboo/bam...">,
0x288e8b5c04e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058ed9
frame #54: 0x00000000018a4d1c Module._extensions..js(this=0x390cbf0582c1:<Object: Object>, 0x23ca55804389:<Object: Module>, 0x2dacad4970c9:<String: "/home/bamboo/bam...">, 0x341fd72dd0c1:<Object: Object>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058429
frame #55: 0x00000000018a4d1c Module.load(this=0x23ca55804389:<Object: Module>, 0x2dacad4970c9:<String: "/home/bamboo/bam...">, 0x288e8b5c04e9:<undefined>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058f49
frame #56: 0x00000000018a4d1c Module._load(this=0x390cbf058071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x23ca55804951:<String: "/home/bamboo/bam...">, 0x288e8b5c0269:<null>, 0x288e8b5c0659:<true>, 0x288e8b5c0659:<true>) at node:internal/modules/cjs/loader:1:10 fn=0x0000390cbf058a71
frame #57: 0x00000000018a4d1c executeUserEntryPoint(this=0x390cbf058071:<function: Module at node:internal/modules/cjs/loader:1:10>, 0x23ca55804951:<String: "/home/bamboo/bam...">, 0x341fd72faf61:<String: "internal/modules...">) at node:internal/modules/run_main:1:10 fn=0x00001903ceaae501
frame #58: 0x00000000018a4d1c (this=0x288e8b5c04e9:<undefined>, 0x390cbf043851:<Object: process>, 0x341fd72ded81:<function: requireBuiltin at node:internal/bootstrap/realm:1:10>, 0x341fd72dedd9:<function: internalBinding at node:internal/bootstrap/realm:1:10>, 0x390cbf049aa1:<Object: Object>, 0x23ca55804a61:<function: at node:internal/main/run_main_module:1:0>) at node:internal/main/run_main_module:1:0 fn=0x000023ca55804a61
frame #59: 0x00000000018a30dc <internal>
frame #60: 0x00000000018a2e03 <entry>
frame #61: 0x000000000102cd5b node-debug`v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&) + 299
frame #62: 0x000000000102ddfc node-debug`v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*) + 108
frame #63: 0x0000000000eef9ea node-debug`v8::Function::Call(v8::Local<v8::Context>, v8::Local<v8::Value>, int, v8::Local<v8::Value>*) + 330
frame #64: 0x0000000000c8bfef node-debug`node::builtins::BuiltinLoader::CompileAndCall(v8::Local<v8::Context>, char const*, node::Realm*) + 255
frame #65: 0x0000000000d3f6c0 node-debug`node::Realm::ExecuteBootstrapper(char const*) + 80
frame #66: 0x0000000000c6217d node-debug`node::StartExecution(node::Environment*, char const*) + 45
frame #67: 0x0000000000c643b5 node-debug`node::StartExecution(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 2885
frame #68: 0x0000000000bc7672 node-debug`node::LoadEnvironment(node::Environment*, std::function<v8::MaybeLocal<v8::Value> (node::StartExecutionCallbackInfo const&)>) + 98
frame #69: 0x0000000000cffc27 node-debug`node::NodeMainInstance::Run(node::ExitCode*, node::Environment*) (.part.0) + 87
frame #70: 0x0000000000d0061d node-debug`node::NodeMainInstance::Run() + 205
frame #71: 0x0000000000c68162 node-debug`node::Start(int, char**) + 1474
It looks like the last JS function is _moduleCompile
in v8-compile-cache
(https://github.com/zertosh/v8-compile-cache/blob/v2.3.0/v8-compile-cache.js#L200)
I inspected the two parameters for this function:
<String: "/home/bamboo/bamboo-agent-home/xml-data/build-dir/MFGX-MFGXPRPLAN7-JOB1/node_modules/.pnpm/pnpm@8.9.0/node_modules/pnpm/dist/pnpm.cjs">
For both core dumps, the values of these variables are the same. Let me know if anything else is required.
Thanks!
We tried settingDISABLE_V8_COMPILE_CACHE =1
in our yaml files and it still crashing the builds.
From some quick search, it seems pnpm is using v8-compile-cache: https://github.com/search?q=repo%3Apnpm%2Fpnpm%20v8-compile-cache&type=code
And yarn seems to use that too, though I am not able to find where the code is: yarnpkg/berry#5987
I noticed that v8-compile-cache only invalidates the cache when the content of the file changes and doesn't seem to do anything if the V8 version/Node.js version mismatches with the cache. That could be a source of bug like this. If
DISABLE_V8_COMPILE_CACHE =1
makes the crash go away, then the crash would be introduced by this package.
It works as workaround in my project. The use case is that the project has lots of AWS Lambda functions written in TS; the intermittent crash happened when parallelly using esbuild
to bundle those functions in jest tests.
We've started to see this crash in our CI agents at Canva. We recently switched to a setup for our ESLint runs where we run ~30 node instances in parallel and we've started intermittently seeing the following crash occur (which is similar to the one listed in the above comment)
#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7fffe32777b0
----- Native stack trace -----
1: 0xc7e785 [node]
2: 0x1aef18a V8_Fatal(char const*, ...) [node]
3: 0x14b6c8c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
4: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
5: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
6: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
7: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
8: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
9: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
10: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
11: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
12: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
13: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
14: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
15: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
16: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
17: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
18: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
19: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
20: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
21: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
22: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
23: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
24: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
25: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
26: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
27: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
28: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
29: 0x14b6d0c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [node]
30: 0x14b84e3 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [node]
31: 0x14b889c int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [node]
32: 0x14b9290 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [node]
33: 0x14bec06 v8::internal::ObjectDeserializer::Deserialize() [node]
34: 0x14bedef v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [node]
35: 0x14b02de v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [node]
36: 0xf0b841 [node]
37: 0xf0bb6d v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [node]
38: 0xe550f8 v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [node]
39: 0xbd8ac1 node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [node]
40: 0xea0812 v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo) [node]
41: 0xea12de [node]
42: 0xea1590 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [node]
43: 0x18a4df6 [node]
It's worth noting that this is the first time we've seen this crash - we run node across most of our CI and we don't see such crashes elsewhere - it's just been since we switched to hyper-parallelising on one machine.
Note:
v20.12.2
v8-compile-cache
(it was removed in v8.23.0 -- https://github.com/eslint/eslint/pull/16235)
v8-compile-cache
I'm still investigating to try and repro or refine the cause - but just posting because it does seem related.
I suspect node::contextify::ContextifyScript might be the root cause of this
We run ~30 node instances simultaneously per eslint CI run and we do a few thousand CI runs per day (i.e. >30k node invocations per day for this new job), but this crash has only occurred about 3 times in the last week. It's very difficult to pin down.
Update - turns out our engineers were just treating it as a flake and retrying without telling us - it's occurring quite frequently across our runs. I don't have an exact number of how often but it's enough that I'll have to figure out an auto-retry workaround for now.
I haven't had any luck with a reproduction though 😢
I suspect node::contextify::ContextifyScript might be the root cause of this
The root cause was likely incorrect cache usage by a user land package or corrupted cache provided by user land package. node::contextify::ContextifyScript is only the API that these packages tend to use to load code cache (typically coupled with monkey patching CJS loader), like what v8-compile-cache does, which was why DISABLE_V8_COMPILE_CACHE =1 works for some people being affected by that package (this is not a Node.js configuration, just a configuration of that npm package). But that’s not the only package that does this and if you have another package in your dependency that does this, you’d need to find what it as and what workaround it has.
I am not sure what else we can do in this repository given that from the stack trace it seems to be mostly caused by bugs in third-party packages (Node.js internally only use node::contextify::ContextifyScript in a few places that are unlikely to be related to this e.g. in the REPL). By default CJS modules are not compiled in this path, it’s usually used by third-party packages monkey patching the CJS loader.
We're generally very careful to avoid v8-compile-cache
in our code because it can cause issues and I had to look hard to find it.
We have some of our ESLint config logic written in .ts
and then the eslint config file uses ts-node
to strip the types at runtime and ts-node
uses v8-compile-cache-lib
under-the-hood.
I'll try DISABLE_V8_COMPILE_CACHE=1
and see how it goes!
Update: It's been a few weeks and it looks like DISABLE_V8_COMPILE_CACHE=1
did indeed fix the issue in our infra
Version
v20.10.0
Platform
Linux codespaces-110a35 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Subsystem
No response
What steps will reproduce the bug?
Sorry, I don't have an easy repro.
How often does it reproduce? Is there a required condition?
I can't repro it reliably, it happens intermittently. In CI, I'm seeing it a few times per day
What is the expected behavior? Why is that the expected behavior?
It shouldn't crash
What do you see instead?