Frontier War crashing on `v1.12` release candidates

GeckoEidechse commented 1 year ago

This issue tracks Frontier War crashing on v1.12 release candidates

It tends to happen towards the last third of the match with 8+ total players in the lobby. Note that the original Frontier War mod used to be stable. In general advancing either or both Launcher or Mods, causes crashes to happen.

Other gamemodes seem to be fine. In particular a playtest on Attrition was crash free for 3 rounds until I switched the server to Frontier War upon which it crashed again mid-game.

Crashing:

v1.12.0-rc3
v1.12.0-rc3 but with the battery call functions assigned statically? (ask @RoyalBlue1 for more info)
v1.12.0-rc3 but with VoyageDB_Modding_Home-Frontier_War_Mod-1.0.1 and the mod updated for fwCampStressX as float
v1.12.0-rc3 on launcher and v1.11.4 on mods with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 and a nearly full server
v1.11.4 on launcher and 1.12.0-rc3 on mods with HTTP stripped from mods to get it to launch

v1.11.4 on launcher and 1.12.0-rc3 on mods with HTTP stripped from mods to get it to launch and

ServerCommand( "sv_max_props_multiplayer 200000" )
ServerCommand( "sv_max_prop_data_dwords_multiplayer 300000" )

commented out

v1.11.4 launcher and v1.12.0-rc1 mods (i.e. before Fortwar got added) with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 from Thunderstore
v1.11.4 with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 and a full server (but it also usually doesn't crash)
https://github.com/R2Northstar/NorthstarLauncher/commit/efc7befe1fc6b6bdec8249e8abf6d2b7cfa1a0ff on launcher and v1.11.4 on mods with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0
https://github.com/R2Northstar/NorthstarLauncher/commit/4fb1ae07d8f078e7abde99900c6a8286148a380a on launcher and v1.11.4 on mods with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0
https://github.com/R2Northstar/NorthstarLauncher/commit/a4aab8da64eded240867fbe51d272aa44a180a26 on launcher and v1.11.4 on mods with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 (crashed but with a different error?)
v1.12.0-rc3 on launcher and https://github.com/R2Northstar/NorthstarMods/pull/564/commits/60e2ee5eeb39c986fb652560096353aa7822a7b2 (FW fixes PR) on mods

Not crashing:

v1.12.0-rc3 with just a single player
v1.12.0-rc3 with just a single player and bots from https://github.com/R2Northstar/NorthstarLauncher/commit/b8e5a4883b0476b0e27e1e3edd5f5432723614f6
v1.11.4 with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 and a full server (but it also crashed one time)
https://github.com/R2Northstar/NorthstarLauncher/commit/a4aab8da64eded240867fbe51d272aa44a180a26 on launcher and v1.11.4 on mods with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 (ran 3 maps until I killed it)
https://github.com/R2Northstar/NorthstarLauncher/commit/4fb1ae07d8f078e7abde99900c6a8286148a380a on launcher and v1.11.4 on mods with VoyageDB_Modding_Home-Frontier_War_Mod-1.1.0 (worked for 3 maps, crashed once)
v1.12.0-rc3 on launcher with a modified version of v1.12.0-rc3 on mods that disables Titans and allows pilots to damage the harvester

GeckoEidechse commented 1 year ago

Sample crash log

[17:36:20] [NORTHSTAR] [info] NorthstarLauncher version: 1.11.4.0
...
[17:45:42] [SCRIPT SV] [info] Requested replacement Titan from eye pos <1430.6, -4222.91, 90.0313> view angles <22.1035, 117.253, 0> player origin <1432.19, -4225.99, 30.0313> map mp_thaw
[17:45:42] [SCRIPT SV] [info] Dropping replacement titan at <1122.8, -3697.33, -236.696> with angles <0, 297.507, 0>
[17:45:42] [SCRIPT SV] [info] Victim: entity (910: npc_spectre fw_npcsFromCamp [910]) BodyGroup: 2 StateIndex: 1
[17:45:42] [NATIVE SV] [warning] Bitpacked snapshot delta is too large
[17:45:43] [NORTHSTAR] [error] Northstar version: 1.11.4.0
[17:45:43] [NORTHSTAR] [error] Northstar has crashed! a minidump has been written and exception info is available below:
[17:45:43] [NORTHSTAR] [error] Loaded mods: 
[17:45:43] [NORTHSTAR] [error] Northstar.Client 1.11.4
[17:45:43] [NORTHSTAR] [error] Northstar.CustomServers 1.11.4
[17:45:43] [NORTHSTAR] [error] Northstar.Custom 1.11.4
[17:45:43] [NORTHSTAR] [error] FWtest 1.1
[17:45:43] [NORTHSTAR] [error] Access Violation: Attempted to read from: 0x0000009DE4B2F9BC
[17:45:43] [NORTHSTAR] [error] At: server.dll + 0x1530db
[17:45:43] [NORTHSTAR] [error] 
[17:45:43] [NORTHSTAR] [error] Stack trace:
[17:45:43] [NORTHSTAR] [error]     Module Name             Offset   Full Address
[17:45:43] [NORTHSTAR] [error] ---------------------------------------------------
[17:45:43] [NORTHSTAR] [error]     server.dll              0x1530db 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error]     server.dll              0x152b3b 0x7fff540d2b3b
[17:45:43] [NORTHSTAR] [error]     server.dll              0x15221f 0x7fff540d221f
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x105d8e 0x7fff2c345d8e
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x11866e 0x7fff2c35866e
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x788d   0x7fff789e788d
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x8077   0x7fff789e8077
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x722f   0x7fff789e722f
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x9652   0x7fff789e9652
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x118753 0x7fff2c358753
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x1189b3 0x7fff2c3589b3
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x109412 0x7fff2c349412
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x108ed4 0x7fff2c348ed4
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x15a0e0 0x7fff2c39a0e0
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x159707 0x7fff2c399707
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x157970 0x7fff2c397970
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x16e9f6 0x7fff2c3ae9f6
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x16dbcb 0x7fff2c3adbcb
[17:45:43] [NORTHSTAR] [error]     Northstar.dll           0xb56d6  0x7fff761356d6
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x1c88c0 0x7fff2c4088c0
[17:45:43] [NORTHSTAR] [error]     Northstar.dll           0xb61be  0x7fff761361be
[17:45:43] [NORTHSTAR] [error]     Northstar.dll           0xa9f98  0x7fff76129f98
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x1c652f 0x7fff2c40652f
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x390e2d 0x7fff2c5d0e2d
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x1c79d9 0x7fff2c4079d9
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x1c793c 0x7fff2c40793c
[17:45:43] [NORTHSTAR] [error]     launcher.dll            0x15afd  0x7fff787d5afd
[17:45:43] [NORTHSTAR] [error]     launcher.dll            0x15afd  0x7fff787d5afd
[17:45:43] [NORTHSTAR] [error]     launcher.dll            0xd386   0x7fff787cd386
[17:45:43] [NORTHSTAR] [error]     NorthstarLauncher.exe   0x491d   0x7ff7c1d2491d
[17:45:43] [NORTHSTAR] [error]     NorthstarLauncher.exe   0x80a8   0x7ff7c1d280a8
[17:45:43] [NORTHSTAR] [error]     KERNEL32.DLL            0x1412   0x7fffec731412
[17:45:43] [NORTHSTAR] [error]     ntdll.dll               0x15504  0x7fffeeed5504
[17:45:43] [NORTHSTAR] [error]     server.dll              0x1530db 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error]     server.dll              0x152b3b 0x7fff540d2b3b
[17:45:43] [NORTHSTAR] [error]     server.dll              0x15221f 0x7fff540d221f
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x105d8e 0x7fff2c345d8e
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x11866e 0x7fff2c35866e
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x788d   0x7fff789e788d
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x8077   0x7fff789e8077
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x722f   0x7fff789e722f
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x9938   0x7fff789e9938
[17:45:43] [NORTHSTAR] [error]     KERNEL32.DLL            0x1412   0x7fffec731412
[17:45:43] [NORTHSTAR] [error]     ntdll.dll               0x15504  0x7fffeeed5504
[17:45:43] [NORTHSTAR] [error]     server.dll              0x1530db 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error]     server.dll              0x152b3b 0x7fff540d2b3b
[17:45:43] [NORTHSTAR] [error]     server.dll              0x15221f 0x7fff540d221f
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x105d8e 0x7fff2c345d8e
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x11866e 0x7fff2c35866e
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x788d   0x7fff789e788d
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x8077   0x7fff789e8077
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x722f   0x7fff789e722f
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x9938   0x7fff789e9938
[17:45:43] [NORTHSTAR] [error]     KERNEL32.DLL            0x1412   0x7fffec731412
[17:45:43] [NORTHSTAR] [error]     ntdll.dll               0x15504  0x7fffeeed5504
[17:45:43] [NORTHSTAR] [error]     server.dll              0x1530db 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error]     server.dll              0x152b3b 0x7fff540d2b3b
[17:45:43] [NORTHSTAR] [error]     server.dll              0x15221f 0x7fff540d221f
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x105d8e 0x7fff2c345d8e
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x11866e 0x7fff2c35866e
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x788d   0x7fff789e788d
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x8077   0x7fff789e8077
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x722f   0x7fff789e722f
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x9938   0x7fff789e9938
[17:45:43] [NORTHSTAR] [error]     KERNEL32.DLL            0x1412   0x7fffec731412
[17:45:43] [NORTHSTAR] [error]     ntdll.dll               0x15504  0x7fffeeed5504
[17:45:43] [NORTHSTAR] [error]     server.dll              0x1530db 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error]     server.dll              0x152b3b 0x7fff540d2b3b
[17:45:43] [NORTHSTAR] [error]     server.dll              0x15221f 0x7fff540d221f
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x105d8e 0x7fff2c345d8e
[17:45:43] [NORTHSTAR] [error]     engine.dll              0x11866e 0x7fff2c35866e
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x788d   0x7fff789e788d
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x8077   0x7fff789e8077
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x784f   0x7fff789e784f
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x7181   0x7fff789e7181
[17:45:43] [NORTHSTAR] [error]     tier0.dll               0x9938   0x7fff789e9938
[17:45:43] [NORTHSTAR] [error]     KERNEL32.DLL            0x1412   0x7fffec731412
[17:45:43] [NORTHSTAR] [error]     ntdll.dll               0x15504  0x7fffeeed5504
[17:45:43] [NORTHSTAR] [error] 
[17:45:43] [NORTHSTAR] [error] Flags: 0b100000000000001011111
[17:45:43] [NORTHSTAR] [error] RIP: 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error] CS : 0x33
[17:45:43] [NORTHSTAR] [error] DS : 0x2b
[17:45:43] [NORTHSTAR] [error] ES : 0x2b
[17:45:43] [NORTHSTAR] [error] SS : 0x2b
[17:45:43] [NORTHSTAR] [error] FS : 0x53
[17:45:43] [NORTHSTAR] [error] GS : 0x2b
[17:45:43] [NORTHSTAR] [error] RAX: 0x0
[17:45:43] [NORTHSTAR] [error] RBX: 0x1
[17:45:43] [NORTHSTAR] [error] RCX: 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error] RDX: 0x7fff53f80000
[17:45:43] [NORTHSTAR] [error] RSI: 0x9d7fa3ec18
[17:45:43] [NORTHSTAR] [error] RDI: 0x9de4def928
[17:45:43] [NORTHSTAR] [error] RBP: 0x1
[17:45:43] [NORTHSTAR] [error] RSP: 0x9d7fa3eaa0
[17:45:43] [NORTHSTAR] [error] R8 : 0x1
[17:45:43] [NORTHSTAR] [error] R9 : 0x9de4def928
[17:45:43] [NORTHSTAR] [error] R10: 0x9d2423aee8
[17:45:43] [NORTHSTAR] [error] R11: 0x7
[17:45:43] [NORTHSTAR] [error] R12: 0x9d24230990
[17:45:43] [NORTHSTAR] [error] R13: 0x13a
[17:45:43] [NORTHSTAR] [error] R14: 0x281c
[17:45:43] [NORTHSTAR] [error] R15: 0x9d05f28c90
[17:45:43] [NORTHSTAR] [error] Xmm0 : [ 335.805, 0, 0, 0], [ 0x43a7e712, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm1 : [ 0.00335805, 0, 0, 0], [ 0x3b5c12c5, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm2 : [ 1.56206E-38, 1.87375, 0, 0], [ 0xaa1800, 0x3fefd6ed, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm3 : [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm4 : [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm5 : [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm6 : [ 3118.22, 4.04866, 0, 0], [ 0x4542e397, 0x40818e9d, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm7 : [ 3118.22, 4.04866, 0, 0], [ 0x4542e397, 0x40818e9d, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm8 : [ 0.0126369, 0, 0, 0], [ 0x3c4f0afe, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm9 : [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm10: [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm11: [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm12: [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm13: [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm14: [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Xmm15: [ 0, 0, 0, 0], [ 0x0, 0x0, 0x0, 0x0 ]
[17:45:43] [NORTHSTAR] [error] Flags: 0b100000000000001011111
[17:45:43] [NORTHSTAR] [error] RIP: 0x7fff540d30db
[17:45:43] [NORTHSTAR] [error] CS : 0x33
[17:45:43] [NORTHSTAR] [error] DS : 0x2b
[17:45:43] [NORTHSTAR] [error] ES : 0x2b
[17:45:43] [NORTHSTAR] [error] SS : 0x2b
[17:45:43] [NORTHSTAR] [error] FS : 0x53

emma-miler commented 1 year ago

[17:17:25] [NORTHSTAR] [error] Northstar version: 1.11.4.0
[17:17:25] [NORTHSTAR] [error] Northstar has crashed! a minidump has been written and exception info is available below:
[17:17:25] [NORTHSTAR] [error] Loaded mods: 
[17:17:25] [NORTHSTAR] [error] Northstar.Client 1.12.0-rc3
[17:17:25] [NORTHSTAR] [error] Northstar.CustomServers 1.12.0-rc3
[17:17:25] [NORTHSTAR] [error] Northstar.Custom 1.12.0-rc3
[17:17:25] [NORTHSTAR] [error] Access Violation: Attempted to read from: 0x00000049A57092D4
[17:17:25] [NORTHSTAR] [error] At: server.dll + 0x1530db
[17:17:25] [NORTHSTAR] [error] 
[17:17:25] [NORTHSTAR] [error] Stack trace:
[17:17:25] [NORTHSTAR] [error]     Module Name    Offset   Full Address
[17:17:25] [NORTHSTAR] [error] ------------------------------------------
[17:17:25] [NORTHSTAR] [error]     server.dll     0x1530db 0x7fff540d30db
[17:17:25] [NORTHSTAR] [error]     server.dll     0x152b3b 0x7fff540d2b3b
[17:17:25] [NORTHSTAR] [error]     server.dll     0x15221f 0x7fff540d221f
[17:17:25] [NORTHSTAR] [error]     engine.dll     0x105d8e 0x7fff2c345d8e
[17:17:25] [NORTHSTAR] [error]     engine.dll     0x11866e 0x7fff2c35866e
[17:17:25] [NORTHSTAR] [error]     tier0.dll      0x788d   0x7fff789e788d
[17:17:25] [NORTHSTAR] [error]     tier0.dll      0x8077   0x7fff789e8077
[17:17:25] [NORTHSTAR] [error]     tier0.dll      0x722f   0x7fff789e722f
[17:17:25] [NORTHSTAR] [error]     tier0.dll      0x9938   0x7fff789e9938
[17:17:25] [NORTHSTAR] [error]     KERNEL32.DLL   0x1412   0x7fffec731412
[17:17:25] [NORTHSTAR] [error]     ntdll.dll      0x15504  0x7fffeeed5504

Seems to be canonical

GeckoEidechse commented 1 year ago

Looks like using a modified version of Frontier War that disables Titans and allows Harvester damage from pilots does not crash

https://cdn.discordapp.com/attachments/936678773150081055/1062853974685925416/Northstar.Custom.7z

GeckoEidechse commented 1 year ago

So it seems

ServerCommand( "sv_max_props_multiplayer 200000" )
ServerCommand( "sv_max_prop_data_dwords_multiplayer 300000" )

https://github.com/R2Northstar/NorthstarMods/blob/main/Northstar.Custom/mod/scripts/vscripts/gamemodes/_gamemode_fw.nut#L136-L137

is set too late and as such does not actually get applied.

GeckoEidechse commented 1 year ago

Ok so setting

sv_max_props_multiplayer 1250000
sv_max_prop_data_dwords_multiplayer 2500000

before starting FW prevents the usual crash :D

R2Northstar / Northstar

Frontier War crashing on `v1.12` release candidates #414