search

LandSandBoat / server

:sailboat: LandSandBoat - a server emulator for Final Fantasy XI
https://landsandboat.github.io/server/
GNU General Public License v3.0
298 stars 602 forks source link

Crash report - PUP/Automaton in Cutscene #652

Closed CatsEyeXI closed 3 years ago

CatsEyeXI commented 3 years ago

Additional Information (Steps to reproduce/Expected behavior) :

Server crashed after player finished LAST Promyvion to access Lufaise Meadows. Player had automaton out during the fight. Automaton acts 'oddly' when already summoned you player zones into a BC, it doesn't register the deployment, and have to resummon.

[08/26/21 07:53:42:826][map][info][info] parse: 051 | 0470 046E 24 from user: Skerxan (parse:632)
[08/26/21 07:53:43:029][topaz_game_64.exe][critical][fatalerror] Exception STATUS_ACCESS_VIOLATION (0XC0000005) occured!
[08/26/21 07:53:43:400][topaz_game_64.exe][critical][stacktrace]     at CBattlefield::RemoveEntity in C:\server-new\src\map\battlefield.cpp: line: 529: address: 0x7FF63B50DC90
[08/26/21 07:53:43:407][topaz_game_64.exe][critical][stacktrace]     at CBaseEntity::~CBaseEntity in C:\server-new\src\map\entities\baseentity.cpp: line: 64: address: 0x7FF63B5D3500
**[08/26/21 07:53:43:410][topaz_game_64.exe][critical][stacktrace]     at CAutomatonEntity::`scalar deleting destructor', address 0x7FF63B5D3D90.**
[08/26/21 07:53:43:410][topaz_game_64.exe][critical][stacktrace] in C:\server\topaz_game_64.exe
CatsEyeXI commented 3 years ago

I am bumping this, because this is apparently a bug with ANY pets. Can reproduce by having pet out, ending a battlefield. This time it happened with a dragoon pet.

[09/06/21 12:55:14:425][map][error][navmesh] CPathFind::FindPath Entity (Goblins_Leech - 17649833) could not find path (CPathFind::FindPath:356) [09/06/21 12:55:14:779][topaz_game_64.exe][critical][fatalerror] Exception STATUS_ACCESS_VIOLATION (0XC0000005) occured! [09/06/21 12:55:14:906][topaz_game_64.exe][critical][stacktrace] at CBattlefield::RemoveEntity in C:\server-new\src\map\battlefield.cpp: line: 529: address: 0x7FF6B45EDC90 [09/06/21 12:55:14:907][topaz_game_64.exe][critical][stacktrace] at CBaseEntity::~CBaseEntity in C:\server-new\src\map\entities\baseentity.cpp: line: 64: address: 0x7FF6B46B3180 [09/06/21 12:55:14:907][topaz_game_64.exe][critical][stacktrace] at CPetEntity::`scalar deleting destructor', address 0x7FF6B46ADB80. [09/06/21 12:55:14:907][topaz_game_64.exe][critical][stacktrace] in C:\server\topaz_game_64.exe [09/06/21 12:55:14:908][topaz_game_64.exe][critical][stacktrace] at CZoneEntities::ZoneServer in C:\server-new\src\map\zone_entities.cpp: line: 1126: address: 0x7FF6B4676320 [09/06/21 12:55:14:908][topaz_game_64.exe][critical][stacktrace] at CZone::ZoneServer in C:\server-new\src\map\zone.cpp: line: 818: address: 0x7FF6B467BCD0 [09/06/21 12:55:14:908][topaz_game_64.exe][critical][stacktrace] at zone_server in C:\server-new\src\map\zone.cpp: line: 85: address: 0x7FF6B467A0A0 [09/06/21 12:55:14:908][topaz_game_64.exe][critical][stacktrace] at CTaskMgr::DoTimer in C:\server-new\src\common\taskmgr.cpp: line: 91: address: 0x7FF6B4682940 [09/06/21 12:55:14:908][topaz_game_64.exe][critical][stacktrace] at main in C:\server-new\src\common\kernel.cpp: line: 495: address: 0x7FF6B468B7D0 [09/06/21 12:55:14:909][topaz_game_64.exe][critical][stacktrace] at __scrt_common_main_seh in d:\agent_work\4\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl: line: 288: address: 0x7FF6B48DA610 [09/06/21 12:55:14:909][topaz_game_64.exe][critical][stacktrace] at BaseThreadInitThunk, address 0x7FFAA4987960. [09/06/21 12:55:14:909][topaz_game_64.exe][critical][stacktrace] in C:\Windows\System32\KERNEL32.DLL [09/06/21 12:55:14:909][topaz_game_64.exe][critical][stacktrace] at RtlUserThreadStart, address 0x7FFAA740A2D0. [09/06/21 12:55:14:909][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll

zach2good commented 3 years ago

What were your steps to reproduce? No crash with:

Balgas Dias
!togglegm
Rank 2 Mission BCNM
Entry CS
!changejob DRG 99
Call Wyvern
Punch mobs to death
Exit CS
Returned to Balgas Dias
CatsEyeXI commented 3 years ago

Good Morning Zach, oddly I was just working to reproduce this myself again so i can provide traces.... I'm not having any luck (or lack of it) this morning... I guess its fine to put this on the back burner until i can figure out what the exact conditions were... All i can say with certainty at this point is that the crash always involved a BC, and a pet being summoned.

CatsEyeXI commented 3 years ago

This happened again... though i still don't have the exact circumstance, this is what the player reports he did:

I had just finish CoP 7-5 fight and while zoning to Al'teau, it crashed i didnt think of it, but i did have a avatar out. crap didnt think about it with SMN sorry all

(My players are aware this can cause crashes at this point)


[09/15/21 23:48:19:543][topaz_game_64.exe][critical][stacktrace]    at CBattlefield::RemoveEntity in C:\server-new\src\map\battlefield.cpp: line: 529: address: 0x7FF6ADF0DC90
[09/15/21 23:48:19:544][topaz_game_64.exe][critical][stacktrace]    at CBaseEntity::~CBaseEntity in C:\server-new\src\map\entities\baseentity.cpp: line: 64: address: 0x7FF6ADFD3180
[09/15/21 23:48:19:544][topaz_game_64.exe][critical][stacktrace]    at CPetEntity::`scalar deleting destructor', address 0x7FF6ADFCDB80.
[09/15/21 23:48:19:544][topaz_game_64.exe][critical][stacktrace] in C:\server\topaz_game_64.exe
[09/15/21 23:48:19:544][topaz_game_64.exe][critical][stacktrace]    at CZoneEntities::ZoneServer in C:\server-new\src\map\zone_entities.cpp: line: 1126: address: 0x7FF6ADF96320
[09/15/21 23:48:19:545][topaz_game_64.exe][critical][stacktrace]    at CZone::ZoneServer in C:\server-new\src\map\zone.cpp: line: 818: address: 0x7FF6ADF9BCD0
[09/15/21 23:48:19:545][topaz_game_64.exe][critical][stacktrace]    at zone_server in C:\server-new\src\map\zone.cpp: line: 85: address: 0x7FF6ADF9A0A0
[09/15/21 23:48:19:545][topaz_game_64.exe][critical][stacktrace]    at CTaskMgr::DoTimer in C:\server-new\src\common\taskmgr.cpp: line: 91: address: 0x7FF6ADFA2940
[09/15/21 23:48:19:545][topaz_game_64.exe][critical][stacktrace]    at main in C:\server-new\src\common\kernel.cpp: line: 495: address: 0x7FF6ADFAB7D0
[09/15/21 23:48:19:546][topaz_game_64.exe][critical][stacktrace]    at __scrt_common_main_seh in d:\agent\_work\4\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl: line: 288: address: 0x7FF6AE1FA610
[09/15/21 23:48:19:546][topaz_game_64.exe][critical][stacktrace]    at BaseThreadInitThunk, address 0x7FFAC1677960.
[09/15/21 23:48:19:546][topaz_game_64.exe][critical][stacktrace] in C:\Windows\System32\KERNEL32.DLL
[09/15/21 23:48:19:546][topaz_game_64.exe][critical][stacktrace]    at RtlUserThreadStart, address 0x7FFAC1F3A2D0.
[09/15/21 23:48:19:546][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[09/15/21 23:48:21:125][map][info][status] do_init: begin server initialization... (do_init:165)```
CatsEyeXI commented 3 years ago

Just happened again (ironically while you're streaming). I am providing a lot more of my log in hopes there's something interesting. Suspected players here are Zinzan/Ladyz

Player warps out of cloister after finishing fight

[09/21/21 13:10:49:688][map][debug][debug] CZone:: Cloister_of_Flames DecreaseZoneCounter <1> Zinzan (CZoneEntities::DecreaseZoneCounter:432)
[09/21/21 13:10:49:758][map][debug][debug] Message: Received message 9 from message server (message::parse:74)
[09/21/21 13:10:50:011][map][info][info] parse: 01A | 0B67 0B66 0E from user: Sulfuricsixx (parse:632)
[09/21/21 13:10:50:011][map][info][action] CLIENT Sulfuricsixx PERFORMING ACTION 02 (SmallPacket0x01A:1047)
[09/21/21 13:10:50:292][map][info][info] parse: 114 | 0162 0161 02 from user: Francis (parse:632)
[09/21/21 13:10:50:363][map][info][info] parse: 01A | 0B5E 0B5D 0E from user: Sulfuric (parse:632)
[09/21/21 13:10:50:363][map][info][action] CLIENT Sulfuric PERFORMING ACTION 02 (SmallPacket0x01A:1047)
[09/21/21 13:10:50:704][map][info][info] parse: 0D2 | 0163 0162 04 from user: Francis (parse:632)
[09/21/21 13:10:50:759][map][info][info] parse: 01A | 0103 0102 0E from user: Pldd (parse:632)
[09/21/21 13:10:50:760][map][info][action] CLIENT Pldd PERFORMING ACTION 03 (SmallPacket0x01A:1047)
[09/21/21 13:10:51:120][map][info][info] parse: 0F4 | 0164 0163 04 from user: Francis (parse:632)
[09/21/21 13:10:51:170][map][info][info] parse: 016 | 033B 033A 04 from user: Ladyz (parse:632)
[09/21/21 13:10:51:522][map][info][info] parse: 0C0 | 0B16 0B14 02 from user: Craftmats (parse:632)
[09/21/21 13:10:51:540][map][info][info] parse: 01A | 0425 0424 0E from user: Shorty (parse:632)
[09/21/21 13:10:51:540][map][info][action] CLIENT Shorty PERFORMING ACTION 03 (SmallPacket0x01A:1047)
[09/21/21 13:10:52:366][map][info][info] parse: 0C0 | 032D 032B 02 from user: Gears (parse:632)
[09/21/21 13:10:52:423][map][info][info] parse: 00A | 0001 0000 2E from user: Zinzan (parse:632)
[09/21/21 13:10:52:423][map][debug][debug] CZone:: RuLude_Gardens IncreaseZoneCounter <3> Zinzan (CZoneEntities::InsertPC:82)
[09/21/21 13:10:52:620][map][info][info] parse: 011 | 0002 0001 04 from user: Zinzan (parse:632)
[09/21/21 13:10:54:232][map][info][info] parse: 03A | 0003 0002 04 from user: Zinzan (parse:632)
[09/21/21 13:10:54:232][map][info][info] parse: 00C | 0003 0002 06 from user: Zinzan (parse:632)
[09/21/21 13:10:54:233][map][info][info] parse: 061 | 0003 0002 04 from user: Zinzan (parse:632)
[09/21/21 13:10:54:233][map][info][info] parse: 118 | 0003 0002 04 from user: Zinzan (parse:632)
[09/21/21 13:10:54:253][map][info][info] parse: 11B | 0003 0002 04 from user: Zinzan (parse:632)
[09/21/21 13:10:54:253][map][info][info] parse: 053 | 0003 0002 44 from user: Zinzan (parse:632)
[09/21/21 13:10:54:253][map][info][info] parse: 01A | 0003 0002 0E from user: Zinzan (parse:632)
[09/21/21 13:10:54:253][map][info][action] CLIENT Zinzan PERFORMING ACTION 14 (SmallPacket0x01A:1047)
[09/21/21 13:10:54:253][map][info][info] parse: 0E0 | 0003 0002 4C from user: Zinzan (parse:632)
[09/21/21 13:10:54:253][map][info][info] parse: 00F | 0003 0002 12 from user: Zinzan (parse:632)
[09/21/21 13:10:54:255][map][info][info] parse: 0DB | 0003 0002 14 from user: Zinzan (parse:632)
[09/21/21 13:10:54:255][map][info][info] parse: 112 | 0003 0002 04 from user: Zinzan (parse:632)
[09/21/21 13:10:54:255][map][info][info] parse: 05A | 0003 0002 02 from user: Zinzan (parse:632)
[09/21/21 13:10:54:754][map][info][info] parse: 016 | 1C75 1C73 04 from user: Arawn (parse:632)
[09/21/21 13:10:54:940][map][info][info] parse: 016 | 1BDE 1BDD 04 from user: Arawnage (parse:632)
[09/21/21 13:10:56:125][map][info][info] parse: 01A | 0347 0346 0E from user: Ladyz (parse:632)
[09/21/21 13:10:56:125][map][info][action] CLIENT Ladyz PERFORMING ACTION 00 (SmallPacket0x01A:1047)
[09/21/21 13:10:56:125][map][info][info] parse: 0C0 | 0347 0346 02 from user: Ladyz (parse:632)
[09/21/21 13:10:56:491][map][info][info] parse: 096 | 0B22 0B20 12 from user: Craftmats (parse:632)
[09/21/21 13:10:57:292][map][info][info] parse: 01A | 034A 0349 0E from user: Ladyz (parse:632)
[09/21/21 13:10:57:292][map][info][action] CLIENT Ladyz PERFORMING ACTION 09 (SmallPacket0x01A:1047)
[09/21/21 13:10:57:652][map][error][error] luautils::onMobDeath: .\scripts/globals/interaction/interaction_lookup.lua:371: attempt to call local 'fallbackHandler' (a nil value)
stack traceback:
    .\scripts/globals/interaction/interaction_lookup.lua:371: in function <.\scripts/globals/interaction/interaction_lookup.lua:367>
    [C]: in function 'despawnPet'
    ./scripts/globals/abilities/release.lua:17: in function <./scripts/globals/abilities/release.lua:16> (luautils::OnMobDeath:3104)
[09/21/21 13:10:57:691][map][info][info] parse: 0DD | 0174 0173 08 from user: Francis (parse:632)
[09/21/21 13:10:57:836][map][info][info] parse: 0C0 | 1C7D 1C7B 02 from user: Arawn (parse:632)
[09/21/21 13:10:57:928][map][info][info] parse: 03A | 0009 0008 04 from user: Zinzan (parse:632)
[09/21/21 13:10:58:941][map][info][info] parse: 01A | 034E 034D 0E from user: Ladyz (parse:632)
[09/21/21 13:10:58:941][map][info][action] CLIENT Ladyz PERFORMING ACTION 00 (SmallPacket0x01A:1047)
[09/21/21 13:11:00:182][map][info][info] parse: 03A | 0F71 0F34 04 from user: Wololo (parse:632)
[09/21/21 13:11:00:990][map][info][info] parse: 0DD | 017C 017B 08 from user: Francis (parse:632)
[09/21/21 13:19:08:249][topaz_game_64.exe][critical][fatalerror] Exception STATUS_ACCESS_VIOLATION (0XC0000005) occured!
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:249][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:250][topaz_game_64.exe][debug][debug] Message: Received message 0 from message server
[09/21/21 13:19:08:390][topaz_game_64.exe][critical][stacktrace]    at CBattlefield::RemoveEntity in C:\server\src\map\battlefield.cpp: line: 529: address: 0x7FF7485EDC90
[09/21/21 13:19:08:390][topaz_game_64.exe][critical][stacktrace]    at CBaseEntity::~CBaseEntity in C:\server\src\map\entities\baseentity.cpp: line: 64: address: 0x7FF7486B3120
[09/21/21 13:19:08:390][topaz_game_64.exe][critical][stacktrace]    at CPetEntity::`scalar deleting destructor', address 0x7FF7486ADB20.
[09/21/21 13:19:08:390][topaz_game_64.exe][critical][stacktrace] in C:\server\topaz_game_64.exe
[09/21/21 13:19:08:391][topaz_game_64.exe][critical][stacktrace]    at CZoneEntities::ZoneServer in C:\server\src\map\zone_entities.cpp: line: 1126: address: 0x7FF748676380
[09/21/21 13:19:08:391][topaz_game_64.exe][critical][stacktrace]    at CZone::ZoneServer in C:\server\src\map\zone.cpp: line: 818: address: 0x7FF74867BD30
[09/21/21 13:19:08:391][topaz_game_64.exe][critical][stacktrace]    at zone_server in C:\server\src\map\zone.cpp: line: 85: address: 0x7FF74867A100
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace]    at CTaskMgr::DoTimer in C:\server\src\common\taskmgr.cpp: line: 91: address: 0x7FF7486829A0
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace]    at main in C:\server\src\common\kernel.cpp: line: 495: address: 0x7FF74868B830
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace]    at __scrt_common_main_seh in d:\agent\_work\4\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl: line: 288: address: 0x7FF7488DAE50
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace]    at BaseThreadInitThunk, address 0x7FFCC06B7960.
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace] in C:\Windows\System32\KERNEL32.DLL
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace]    at RtlUserThreadStart, address 0x7FFCC322A2D0.
[09/21/21 13:19:08:392][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll

http://catseyexi.com/topaz_game_64.zip

CatsEyeXI commented 3 years ago

Although as you stated it probably won't be much use, I've attached dump, pdb, exe, and map-server.log. (link above) Will continue investigating this independently.

CatsEyeXI commented 3 years ago

I managed to get this on video.

https://youtu.be/wch4jV_ISb0?t=283

CatsEyeXI commented 2 years ago

hate to say this issue still exists...

[11/18/21 18:59:24:416][map][debug][debug] CZone:: Mamool_Ja_Training_Grounds DecreaseZoneCounter <0> Pharaun (CZoneEntities::DecreaseZoneCounter:432) [11/18/21 18:59:24:419][map][debug][debug] [CZoneInstance]DecreaseZoneCounter cleaned up Instance imperial_agent_rescue (CZoneInstance::DecreaseZoneCounter:171) [11/18/21 18:59:24:419][topaz_game_64.exe][critical][fatalerror] Exception STATUS_ACCESS_VIOLATION (0XC0000005) occured! [11/18/21 18:59:24:432][topaz_game_64.exe][debug][debug] Message: Received message 9 from message server [11/18/21 18:59:24:516][topaz_game_64.exe][critical][stacktrace] at CBattlefield::RemoveEntity in C:\server\src\map\battlefield.cpp: line: 514: address: 0x7FF7598BDC90 [11/18/21 18:59:24:516][topaz_game_64.exe][critical][stacktrace] at CBaseEntity::~CBaseEntity in C:\server\src\map\entities\baseentity.cpp: line: 64: address: 0x7FF759983600 [11/18/21 18:59:24:517][topaz_game_64.exe][critical][stacktrace] at CNpcEntity::`scalar deleting destructor', address 0x7FF759983CA0. [11/18/21 18:59:24:517][topaz_game_64.exe][critical][stacktrace] in C:\server\topaz_game_64.exe [11/18/21 18:59:24:517][topaz_game_64.exe][critical][stacktrace] at CInstance::~CInstance in C:\server\src\map\instance.cpp: line: 50: address: 0x7FF7598D1210 [11/18/21 18:59:24:517][topaz_game_64.exe][critical][stacktrace] at std::vector<std::unique_ptr<CInstance,std::default_delete >,std::allocator<std::unique_ptr<CInstance,std::default_delete > > >::erase in C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\include\vector: line: 1420: address: 0x7FF759949FF0 [11/18/21 18:59:24:517][topaz_game_64.exe][critical][stacktrace] at CZoneInstance::DecreaseZoneCounter in C:\server\src\map\zone_instance.cpp: line: 180: address: 0x7FF759948AB0 [11/18/21 18:59:24:518][topaz_game_64.exe][critical][stacktrace] at SmallPacket0x00D in C:\server\src\map\packet_system.cpp: line: 535: address: 0x7FF7598F45F0 [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] at parse in C:\server\src\map\map.cpp: line: 659: address: 0x7FF7598DD230 [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] at do_sockets in C:\server\src\map\map.cpp: line: 416: address: 0x7FF7598DC310 [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] at main in C:\server\src\common\kernel.cpp: line: 495: address: 0x7FF75995BCD0 [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] at __scrt_common_main_seh in d:\a01_work\6\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl: line: 288: address: 0x7FF759BAE2A0 [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] at BaseThreadInitThunk, address 0x7FFFAF557960. [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] in C:\Windows\System32\KERNEL32.DLL [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] at RtlUserThreadStart, address 0x7FFFB08BA2D0. [11/18/21 18:59:24:519][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll

CatsEyeXI commented 2 years ago 

[12/28/21 20:10:40:051][map][debug][debug] CZone:: Aht_Urhgan_Whitegate DecreaseZoneCounter <0> Happy (CZoneEntities::DecreaseZoneCounter:432)
[12/28/21 20:10:40:057][topaz_game_64.exe][critical][fatalerror] Exception STATUS_HEAP_CORRUPTION (0XC0000374) occured!
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at RtlIsNonEmptyDirectoryReparsePointAllowed, address 0x7FFFAE70A890.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at RtlIsNonEmptyDirectoryReparsePointAllowed, address 0x7FFFAE70A890.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at RtlpNtMakeTemporaryKey, address 0x7FFFAE712D30.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at RtlpNtMakeTemporaryKey, address 0x7FFFAE712D30.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at RtlRaiseStatus, address 0x7FFFAE6AEDF0.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at memset, address 0x7FFFAE6B6800.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace]    at free_base, address 0x7FFFAB1BB370.
[12/28/21 20:10:40:136][topaz_game_64.exe][critical][stacktrace] in C:\Windows\System32\ucrtbase.dll
[12/28/21 20:10:40:188][topaz_game_64.exe][critical][stacktrace]    at CCharEntity::~CCharEntity in C:\server\src\map\entities\charentity.cpp: line: 256: address: 0x7FF76D349EE0
[12/28/21 20:10:40:189][topaz_game_64.exe][critical][stacktrace]    at CCharEntity::`scalar deleting destructor', address 0x7FF76D349EA0.
[12/28/21 20:10:40:189][topaz_game_64.exe][critical][stacktrace] in C:\server\topaz_game_64.exe
[12/28/21 20:10:40:193][topaz_game_64.exe][critical][stacktrace]    at map_close_session in C:\server\src\map\map.cpp: line: 844: address: 0x7FF76D2AF220
[12/28/21 20:10:40:193][topaz_game_64.exe][critical][stacktrace]    at do_sockets in C:\server\src\map\map.cpp: line: 438: address: 0x7FF76D2AC5A0
[12/28/21 20:10:40:194][topaz_game_64.exe][critical][stacktrace]    at main in C:\server\src\common\kernel.cpp: line: 495: address: 0x7FF76D32D2B0
[12/28/21 20:10:40:194][topaz_game_64.exe][critical][stacktrace]    at __scrt_common_main_seh in d:\a01\_work\6\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl: line: 288: address: 0x7FF76D58C470
[12/28/21 20:10:40:194][topaz_game_64.exe][critical][stacktrace]    at BaseThreadInitThunk, address 0x7FFFABA17960.
[12/28/21 20:10:40:194][topaz_game_64.exe][critical][stacktrace] in C:\Windows\System32\KERNEL32.DLL
[12/28/21 20:10:40:194][topaz_game_64.exe][critical][stacktrace]    at RtlUserThreadStart, address 0x7FFFAE66A2D0.
[12/28/21 20:10:40:194][topaz_game_64.exe][critical][stacktrace] in C:\Windows\SYSTEM32\ntdll.dll```
TeoTwawki commented 2 years ago

open a new one instead of posting new crashes to an old one. that doesn't even look related

CatsEyeXI commented 2 years ago

I don't really know what I'm looking at but the similarity was the "scalar deleting destructor". No idea what it means but it's the same message. I'll happily open a new one though when I'm back at my PC

TeoTwawki commented 2 years ago

I don't really know what I'm looking at but the similarity was the "scalar deleting destructor". No idea what it means but it's the same message. I'll happily open a new one though when I'm back at my PC

It shows. STATUS_HEAP_CORRUPTION and a character entity in one, STATUS_ACCESS_VIOLATION and an NPC entity in the other (neither of which have anything to do with a puppet). You've got to learn how to read a call stack. This is essential for being a server operator. It is telling you in that log which function calls it ran through as well as the final errors type. And something about that last one doesn't jive with whats in our repo. I've never seen a crash there you are the only one to ever find this one, and the odds of that are insane.

CatsEyeXI commented 2 years ago

I don't really know what I'm looking at but the similarity was the "scalar deleting destructor". No idea what it means but it's the same message. I'll happily open a new one though when I'm back at my PC

It shows. STATUS_HEAP_CORRUPTION and a character entity in one, STATUS_ACCESS_VIOLATION and an NPC entity in the other (neither of which have anything to do with a puppet). You've got to learn how to read a call stack. This is essential for being a server operator. It is telling you in that log which function calls it ran through as well as the final errors type. And something about that last one doesn't jive with whats in our repo. I've never seen a crash there you are the only one to ever find this one, and the odds of that are insane.

Good Morning Teo. If you can, disregard the title of the issue for a minute. I didn't quite understand the scale of the issue at the time of creating it. The common element between the original crash and all subsequent crashes i've posted here, as well as shown videos for, have one thing in common: They all occur when a character tries to zone and for some reason fails to, crashing the server. In the original issue, player was zoning from a BCNM to Lufaise Meadows after winning, in this case, Player was zoning out of Aht Urgan Whitegate to Al Zahbi (I was sure to include that line as well).

I'm not opposed to learning how to read a call trace (that wouldn't be the first thing I've had to learn on this project), but that would be the first time in 25 years of server administration that someone has asked me to do so. This interaction with developers is helping so I ask for a small amount of patience... some of this is far from what I'm used to working with.

I've never seen a crash there you are the only one to ever find this one, and the odds of that are insane.

Not sure what you're trying to say here, but I'm not using any sort of black magic or wild hackery on my server that would deem it unstable or prone to crashing. I'll happily share the contents of repo with you so you can see for yourself.

TeoTwawki commented 2 years ago

your 25 years of server administration has zero to do with running "the server" here. same word, different context. to be an effective ffxi server owner, you need to know how to do this. Just Giving you the 411, no insults intended.

> to quote text btw. little hard to read without it.

Not sure what you're trying to say here, but I'm not using any sort of black magic or wild hackery on my server that would deem it unstable or prone to crashing. I'll happily share the contents of repo with you so you can see for yourself.

I'm saying there HAS to be something different from norms because we would certainly notice if people were crashing at destructing entities just by zoning. This is completely un-reproducible at my end. Its not necessarily something in your code. In fact I have a gut feeling there is a usage problem os problem or possibly even hardware problem. Might help to describe your setup a bit in the next issue, attached vs debugger to the map server while its running till the next crash hits. When it implodes vs will let you browse the stack like a tree to see the name of the involved player(s), zone(s), item(s) etc. Something had to go wrong before it hits that destructor, or we'd all see that crash 24/7/365.

Has any sort of funny behavior happened with any of the other exe's or even stuff unrelated to ffxi on the same machine? Like, ONLY map server going screwy and nothing else? Ironically having additional problems might help narrow down the cause of your problems.

CatsEyeXI commented 2 years ago

your 25 years of server administration has zero to do with running "the server" here. same word, different context. to be an effective ffxi server owner, you need to know how to do this. Just Giving you the 411, no insults intended.

> to quote text btw. little hard to read without it.

Not sure what you're trying to say here, but I'm not using any sort of black magic or wild hackery on my server that would deem it unstable or prone to crashing. I'll happily share the contents of repo with you so you can see for yourself.

I'm saying there HAS to be something different from norms because we would certainly notice if people were crashing at destructing entities just by zoning. This is completely un-reproducible at my end. Its not necessarily something in your code. In fact I have a gut feeling there is a usage problem os problem or possibly even hardware problem. Might help to describe your setup a bit in the next issue, attached vs debugger to the map server while its running till the next crash hits. When it implodes vs will let you browse the stack like a tree to see the name of the involved player(s), zone(s), item(s) etc. Something had to go wrong before it hits that destructor, or we'd all see that crash 24/7/365.

Has any sort of funny behavior happened with any of the other exe's or even stuff unrelated to ffxi on the same machine? Like, ONLY map server going screwy and nothing else? Ironically having additional problems might help narrow down the cause of your problems.

How long can I run the map server inside of VS? This issue doesn't happen "often". It ran 2 days before crashing most recently.

Thanks

TeoTwawki commented 2 years ago

How long can I run the map server inside of VS?

I've had it run like that for 4+ weeks at a time without issue.

p.s. If it felt I was acting impatient with you or looking down on you or the like I apologize. I know I can be very blunt and or inconsiderate in my wording at times. I try not to be but from time to time such things slip by me. The whole project is a hobby so professional level support doesn't really exist but everyone tries to at least behave professional with the contributors and users and if I failed at that I am sorry.

CatsEyeXI commented 2 years ago

How long can I run the map server inside of VS?

I've had it run like that for 4+ weeks at a time without issue.

p.s. If it felt I was acting impatient with you or looking down on you or the like I apologize. I know I can be very blunt and or inconsiderate in my wording at times. I try not to be but from time to time such things slip by me. The whole project is a hobby so professional level support doesn't really exist but everyone tries to at least behave professional with the contributors and users and if I failed at that I am sorry.

Thanks for clearing that up, I was a little offended at first but I feel better now. I'm not a guy who wants to tie up too many of "yall's" free cycles troubleshooting my BS. I know you guys have better things to do. I always appreciate the dialog with you even though it may seem a bit harsh at times because in the end I usually learn something new.