dr3ams / Roguelike-Adventures-and-Dungeons-2

Roguelike Adventures and Dungeons 2
https://www.curseforge.com/minecraft/modpacks/roguelike-adventures-and-dungeons-2
Other
54 stars 17 forks source link

[Bug]: Can't keep up! Is the server overloaded? #342

Closed Scampi-ml closed 11 months ago

Scampi-ml commented 1 year ago

General Info

Your launcher

Curseforge

Modpack version (Do not say latest check curseforge has it on modpacks icon)

1.16

Describe your issue

Can't keep up! Is the server overloaded? Running XXXXXms or XXX ticks behind

Steps to reproduce the issue

We dont know, we just play the game. There is nothing that seems to trigger this specifically.

Additional Information

It is definitely not the hardware of the way the server is running. We can reproduce this on different hardware / software / setup.

We tried the following:

Even when the server is just ready booting, is is already 8000ms or 163 ticks behind. It gets even worse the more players are on. We have a MAX of 7 player. When all players are playing we seen numbers up to 48000+ ms and 550+ ticks behind making the game unplayable.

There is a boss with a big axe with a sword in his back, i forgot the name, but we cant kill him since we cant see his movements anymore and we get attacked out of nowhere since its so laggy.

We dont have any tools to figure out what might be the issue.

Startup log: https://pastebin.com/Wcaub3rd

DoctorMage commented 1 year ago

Make sure you have the correct modpack version 1.16 is not a released version

and please actually state the server specs

Cpu (vcpu), ram

and how it is being hosted provider or own system if its on its own system wether its a laptop or desktop and what operating system its on

also

https://www.curseforge.com/minecraft/mc-mods/spark/files/3767277 add spark /spark profiler do that leave it for 5 minutes then /spark profiler --stop

but for refrence large modpacks will have performance issues with 7 players unless you pregen (do not say xy modpack has better performance different mods different performance and issues)

DoctorMage commented 1 year ago

to be more precise Can't keep up! Is the server overloaded? Running XXXXXms or XXX ticks behind

is normal with large modpacks just depends on the amount and how often is it

there a few factors that come into play

cpu that is being used to host the server wether it's a laptop or desktop operating system

additional mods added, what processes are being done on the server (exploring is a large one as world gen is the main culprit in server performance hits)

Scampi-ml commented 1 year ago

OK np, here are the specs:

Its a repurposed high-end gaming PC on a 1/2 Gb cable connection (i do play on 192 network, same results)

Proxmox 7.4-16 running on a:

So Proxmox - > Windows VM (W10 LTSC)

The VM has 20Gb RAM - 512 Gb Storage - 2 sockets 2 cores CPU's

Ill try the spark later

JAVA ARGS java -Xms8G -Xmx17G -XX:+UnlockExperimentalVMOptions -XX:+UseG1GC -XX:G1NewSizePercent=20 -XX:G1ReservePercent=20 -XX:MaxGCPauseMillis=50 -XX:G1HeapRegionSize=32M -jar forge-1.16.5-36.2.39.jar --nogui

Scampi-ml commented 1 year ago

Ive given the VM and the server even more RAM, just to be sure Ok here are the results:

My client: https://spark.lucko.me/YXaPMOgbeZ The Console: https://spark.lucko.me/ypTZnzZkYZ

i think the storage might be the issue? image

Here is what it look like, 5000(free) / 17000(total) slots

DoctorMage commented 1 year ago

Yeah storage can have an effect

Keep it to one chunk and not doing to much

I cant fully check right now

On Fri, 8 Sep 2023, 09:00 janvier123, @.***> wrote:

Ok here are the results:

My client: https://spark.lucko.me/YXaPMOgbeZ The Console: https://spark.lucko.me/ypTZnzZkYZ

i think the storage might be the issue? [image: image] https://user-images.githubusercontent.com/1528455/266542785-45f5c18f-d641-4af1-b7b9-c1e285d02be9.png

Here is what it look like, 5000(free) / 17000(total) slots

— Reply to this email directly, view it on GitHub https://github.com/dr3ams/Roguelike-Adventures-and-Dungeons-2/issues/342#issuecomment-1711246121, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUK5WNM4GX37PSP5JKT4LFLXZLGBZANCNFSM6AAAAAA4NMNPLI . You are receiving this because you commented.Message ID: @.*** com>

Scampi-ml commented 1 year ago

So i have moved the entire storage to 1 chunk, no improvements. My guess is the storage mod is way to old (it was still under development at V1.2.19) and still contains bugs / bad optimize code.

Its getting way worse with the growth of more items.

[14Sep2023 21:20:09.915] : Can't keep up! Is the server overloaded? Running 5804ms or 116 ticks behind [14Sep2023 21:20:39.978] : Can't keep up! Is the server overloaded? Running 15067ms or 301 ticks behind [14Sep2023 21:21:27.171] : Can't keep up! Is the server overloaded? Running 32210ms or 644 ticks behind [14Sep2023 21:22:13.859] : Can't keep up! Is the server overloaded? Running 31698ms or 633 ticks behind [14Sep2023 21:23:00.013] : Can't keep up! Is the server overloaded? Running 31202ms or 624 ticks behind [14Sep2023 21:23:31.586] : Can't keep up! Is the server overloaded? Running 16576ms or 331 ticks behind [14Sep2023 21:23:52.250] : Can't keep up! Is the server overloaded? Running 5689ms or 113 ticks behind [14Sep2023 21:24:12.069] : Can't keep up! Is the server overloaded? Running 4858ms or 97 ticks behind [14Sep2023 21:24:45.576] : Can't keep up! Is the server overloaded? Running 18515ms or 370 ticks behind [14Sep2023 21:25:34.045] : Can't keep up! Is the server overloaded? Running 33485ms or 669 ticks behind [14Sep2023 21:26:22.471] : Can't keep up! Is the server overloaded? Running 33461ms or 669 ticks behind [14Sep2023 21:27:11.054] : Can't keep up! Is the server overloaded? Running 33594ms or 671 ticks behind [14Sep2023 21:27:58.162] : Can't keep up! Is the server overloaded? Running 32152ms or 643 ticks behind [14Sep2023 21:28:30.233] : Can't keep up! Is the server overloaded? Running 17073ms or 341 ticks behind [14Sep2023 21:29:11.715] : Can't keep up! Is the server overloaded? Running 26504ms or 530 ticks behind (a bit of code removed for better readability )

Sometimes the watchdog timer kicks in and shuts down the server, resulting in partial rollbacks (+-3-5min).

DoctorMage commented 1 year ago

what does the spark log look like now

also is it the same after disabling tom (as in breaking the blocks connected to chest)

Scampi-ml commented 1 year ago

Results are in:

So restarted the server with spark

Ran Spark again: Broke the "connector block" and a few cable blocks, nothing was working, good. Ran to my house (20sec), tried to open a normal chest .... would open, tried different chest ... same.

A few seconds later, server crash.

-> https://pastebin.com/v2XkZuFk

Booted the server again;

Ran spark: https://spark.lucko.me/jmOQjNidgB But i forgot to stop it first, so i reconnected and stopped then. HOWEVER i did notice a quicker response from the server. Everything was quicker, even loading times to various places.

So yes, i believe it is a bug somewhere in Toms Simple Storage 1.2.19. So my (temporarily) fix would be to remove this version and look for a more up-to-date version or a different mod. I did not research why the Simple Network Storage mod was removed in the first place. #108 #134 (i do now)

So removing mod and forcing everyone to manual remove and re-download one would be a minor issue.

PS: ive seen a yt video where a this guy said that normal chests can cause lagg, so he said to changed to barrels instead. It did not change anything.

EDIT:

It seems we are running the latest version for MC 1.16.5.

image

Any ideas?

DoctorMage commented 12 months ago

other than removing toms and seeing how server peformance is

you can try adaptive performance tweaks https://discord.com/channels/512339624627011586/512340728215502878/1080526848812908644

theres a pre made config in the discord server

Scampi-ml commented 12 months ago

Sorry no improvement

DoctorMage commented 11 months ago

what does spark show also how many players on average?

Scampi-ml commented 11 months ago

The more we used the storage the more lagg was created, till the point of unbearable/unplayable. We have moved on to All the mods 9.

ahuston-0 commented 11 months ago

@Janvier123 for future reference I had a similar issue and ended up changing sync-chunk-writes to false in order to get the lag to stop. In my particular case, I'm running my server storage on ZFS with a SLOG device, but instead of doing async writes the minecraft container was trying to force sync everything.