Server crashes a lot recently (memory overflow restarts)

[CozyDoomer]

The interval varies quite a lot but in my experience, it happens roughly every few minutes to 2 hours.

People in the in-game chat are saying it happens when a near-infinite amount of triggers are created (e.g. storm with way more than 20 triggers) but I have no evidence for this. I do know however that recently the game has been almost unplayable due to the crashes so I'd like to help where I can.

@JayDi85 do you have anything in your logs? Also not sure if this came up already - I couldn't find any issues on this except maybe #10656.

[JayDi85]

There are only two candidates:

1. Commander cards with miss init code (details in #11081). That error can freeze game and run infinite errors logs until server's restart. It's not a 100% of all memory overflow/restarts.
2. Transformable cards with too much calls of game cycle: It's a daybound/nightbound cards like [[Child of the Pack]] that can cause too much calls of checkStateBasedActions -> transform in the games. If you put that cards to the battlefield then it will dramatically increase cpu usage and applyEffects calls, see attached screenshot from one of the heavy server's game:

[github-actions[bot]]

Child of the Pack // Savage Packmate - (Gatherer) (Scryfall) (EDHREC)

{2}{R}{G} Creature — Human Werewolf 2/5 {2}{R}{G}: Create a 2/2 green Wolf creature token. Daybound (If a player casts no spells during their own turn, it becomes night next turn.) :arrows_counterclockwise: Creature — Werewolf 5/5 Trample Other creatures you control get +1/+0. Nightbound (If a player casts at least two spells during their own turn, it becomes day next turn.)

[whispy]

+1, the server crashes all of the time. I'd be willing to contribute to a bounty to get this fixed and reduce crashes.

[JayDi85]

There are added new global features like Prototype mechanics (#11249), so prepare for more unstable times until this whole things stabilises.

[ssk97]

There are added new global features like Prototype mechanics (#11249), so prepare for more unstable times until this whole things stabilises.

I don't really see how Prototype could cause a server crash, worst case would be a game crash that doesn't touch the rest of the server, right? Unless the single boolean added to each permanent somehow is too much extra data...

[JayDi85]

worst case would be a game crash that doesn't touch the rest of the server, right?

Nope. All server restarts related to the memory overflow error: java's garbage collector (GC) can't clean and free objects due circular references between game states or other game objects. So one broken game can eats all server's memory and crash whole server. Under the hood: xmage uses thread's pool to process games and you can't limit memory usage for specific thread/game.

The main problem of memory overflow errors -- it's hard to catch and repeat. It must be a combo of two things:

• bugged code with generating shared objects between game states;
• infinite loop that can generate a large number of calls of the problem code.

Well, whole xmage code base can generates such "shared" objects, but it's ok in 99% due game lifecycle. On game ends it will be closed and all game's memory will be free anyway. But inifinite/freeze game doesn't ends and eats memory by time.

There are possible another use cases like infinite number of objects like AI and mana variations calculation, AI and infinite choose dialogs, infinite number of tokens (no more actual), etc. But it's more easy to catch.

P.S. The main "problem" of new big features -- it adds new batch of possible bad combos or use cases to generate such infinite loops and freezes. So players can find out new steps to reproduce it on the server.

P.P.S. Related topics about memory problem:

• 4520

[ssk97]

P.S. The main "problem" of new big features -- it adds new batch of possible bad combos or use cases to generate such infinite loops and freezes. So players can find out new steps to reproduce it on the server.

Right, but Prototype specifically isn't really doing anything new there that Transform isn't already doing. Though it does seem that Transform does have performance issues which, if true, could be made worse by Prototype I suppose. It doesn't involve any game.applyEffects() calls though so the performance issue mentioned above shouldn't matter.

[JayDi85]

One of the use case from #9302:

Putting 100s of abilities on the stack at once will crash the server Easiest way to reproduce, add 10-30 [[Sharding Sphinx]] to your board and a [[Platinum Angel]] to the AI so they won't lose the game. When damage is deal this will put a few hundred triggers from the Sharing Sphinx on the board. This will cause the server to lock up a large amount of RAM (20 Sphinxes will lock up ~450MB of ram). This ram can't be CG'ed away until the stack empties.

[ShadowKayoto]

I'd also like to chime in that this should be the most urgent issue to look into and address. No amount of coding efforts on this project matter if no one can actually enjoy what's been created and maintained all this time, which is currently the case.

Is there any way to identify and prevent some of these cases from occurring? It looks like you have metrics and call stacks available, so figuring out the most frequent causes should be possible, and then prioritizing the fixes from there.

Like @whispy mentioned already, I'm also willing to donate towards the goal of getting the server stabilized.

[JayDi85]

Load tests can be useful to find problems with the cards or AI. Also it allows to test cards and server's stability.

As example:

• start local server;
• open LoadTest file and setup testing cards by:
  • TEST_AI_RANDOM_DECK_SETS
  • TEST_AI_CUSTOM_DECK_PATH_1
  • TEST_AI_CUSTOM_DECK_PATH_2
• setup games amount to run by gamesAmount;
• run unit test test_TwoAIPlayGame_Multiple
• wait final results;
• if you see a problem/slow game, then you can repeat it by manual random sid in singleGameSID;

[JayDi85]

Main memory problem fixed, so server must be more stable. See details here: https://github.com/magefree/mage/issues/9302#issuecomment-1762853919. But there are still todos and check for next updates, e.g. CPU usage on Transform ability (see above).

[JayDi85]

One of the unknown use case with 90% CPU freeze: Constructed - Legacy | DaddyGreen, Urzasdestiny [quit] | Two Player Duel |

AddCountersSourceEffect and some triggers:

Empty stack and permanents on battlefield (except lands, I'm not sure that it's a moment of high CPU or after it, but it's a problem game 100%):

• [[CityOfTraitors]]
• [[GrimLavamancer]] with one boost counter on it
• [[DragonsRageChanneler]]
• [[DelverOfSecrets]]
• [[ChromeMox]]

[github-actions[bot]]

City of Traitors - (Gatherer) (Scryfall) (EDHREC)

Land When you play another land, sacrifice City of Traitors. {T}: Add {C}{C}.

Grim Lavamancer - (Gatherer) (Scryfall) (EDHREC)

{R} Creature — Human Wizard 1/1 {R}, {T}, Exile two cards from your graveyard: Grim Lavamancer deals 2 damage to any target.

Dragon's Rage Channeler - (Gatherer) (Scryfall) (EDHREC)

{R} Creature — Human Shaman 1/1 Whenever you cast a noncreature spell, surveil 1. (Look at the top card of your library. You may put that card into your graveyard.) Delirium — As long as there are four or more card types among cards in your graveyard, Dragon's Rage Channeler gets +2/+2, has flying, and attacks each combat if able.

Delver of Secrets // Insectile Aberration - (Gatherer) (Scryfall) (EDHREC)

{U} Creature — Human Wizard 1/1 At the beginning of your upkeep, look at the top card of your library. You may reveal that card. If an instant or sorcery card is revealed this way, transform Delver of Secrets. :arrows_counterclockwise: Creature — Human Insect 3/2 Flying

Chrome Mox - (Gatherer) (Scryfall) (EDHREC)

{0} Artifact Imprint — When Chrome Mox enters the battlefield, you may exile a nonartifact, nonland card from your hand. {T}: Add one mana of any of the exiled card's colors.

[xenohedron]

Thanks for your deep research and improvements @JayDi85 , great work

[JayDi85]

Another one possible use case from a problem game:

• [[Rite of Replication]] on the stack
• [[Ancient Greenwarden]] on the battlefield as 160+ tokens and active triggers/effects
• [[Primal Vigor]] on battlefield as 9 active token and counter triggers/effects
• [[Nyxbloom Ancient]]

[github-actions[bot]]

Rite of Replication - (Gatherer) (Scryfall) (EDHREC)

{2}{U}{U} Sorcery Kicker {5} (You may pay an additional {5} as you cast this spell.) Create a token that's a copy of target creature. If this spell was kicked, create five of those tokens instead.

Ancient Greenwarden - (Gatherer) (Scryfall) (EDHREC)

{4}{G}{G} Creature — Elemental 5/7 Reach You may play lands from your graveyard. If a land entering the battlefield causes a triggered ability of a permanent you control to trigger, that ability triggers an additional time.

Primal Vigor - (Gatherer) (Scryfall) (EDHREC)

{4}{G} Enchantment If one or more tokens would be created, twice that many of those tokens are created instead. If one or more +1/+1 counters would be put on a creature, twice that many +1/+1 counters are put on that creature instead.

Nyxbloom Ancient - (Gatherer) (Scryfall) (EDHREC)

{4}{G}{G}{G} Enchantment Creature — Elemental 5/5 Trample If you tap a permanent for mana, it produces three times as much of that mana instead.

[jeffwadsworth]

@JayDi85 I could have sworn I saw that "test_TwoAIPlayGame_Multiple" test in the test folder in the past, but now I can't find it.

[JayDi85]

@jeffwadsworth It ignored by default. Mage.Verify project -> LoadTest.java -> test_TwoAIPlayGame_Multiple

[Susucre]

@JayDi85 an user on the Discord reported a crash of the beta server. The reported situation was 500 [[Ramos Dragon Engine]] tokens then triggering them all by casting a multicolored spell.

[github-actions[bot]]

Ramos, Dragon Engine - (Gatherer) (Scryfall) (EDHREC)

{6} Legendary Artifact Creature — Dragon 4/4 Flying Whenever you cast a spell, put a +1/+1 counter on Ramos, Dragon Engine for each of that spell's colors. Remove five +1/+1 counters from Ramos: Add {W}{W}{U}{U}{B}{B}{R}{R}{G}{G}. Activate only once each turn.

[JayDi85]

Need more combo examples to crash a server (triggers overflow, etc).

[JayDi85]

Last crash from that game with high CPU usage: [Not CDEH/ No infinite combo] Martin - azert - B24M - vsdiaz

Don't know the real battlefield situation or steps to reproduce, but CPU "stack" looks very strange cause LookAtTopCardOfLibraryAnyTimeEffect is ContinuousEffect -- it applies on every game cycle. BUT it calls a network code to send data to users (fireUpdatePlayersEvent):

I think it was a workaround to force a user update (in old days reveals/lookat windows may miss on choose dialog until next update/avatar click). So that broken code (fire event) must be removed from all places, not only continues effects:

[JayDi85]

Just interesting screenshot with good and bad games example:

[JayDi85]

well, it's can be a real cheater/troll now -- crashed server on main phase of turn 1 (T1M1) with 300 replacement effects and 500 permanents on battlefield

GAME started 5234893d-a6e0-4ed7-baf3-2840f39599cf [] icarus - oranges

Freeze on choose chooseReplacementEffect with 230 effects to choose:

3 auto-selected choices by user: [[Ancient Greenwarden]], [[Nyxbloom Ancient]] and [[Primal Vigor]]

1 spell on stack: [[Mythos of Illuna]]

~500 permanents on battlefield:

[github-actions[bot]]

Ancient Greenwarden - (Gatherer) (Scryfall) (EDHREC)

{4}{G}{G} Creature — Elemental 5/7 Reach You may play lands from your graveyard. If a land entering the battlefield causes a triggered ability of a permanent you control to trigger, that ability triggers an additional time.

Nyxbloom Ancient - (Gatherer) (Scryfall) (EDHREC)

{4}{G}{G}{G} Enchantment Creature — Elemental 5/5 Trample If you tap a permanent for mana, it produces three times as much of that mana instead.

Primal Vigor - (Gatherer) (Scryfall) (EDHREC)

{4}{G} Enchantment If one or more tokens would be created, twice that many of those tokens are created instead. If one or more +1/+1 counters would be put on a creature, twice that many +1/+1 counters are put on that creature instead.

Mythos of Illuna - (Gatherer) (Scryfall) (EDHREC)

{2}{U}{U} Sorcery Create a token that's a copy of target permanent. If {R}{G} was spent to cast this spell, instead create a token that's a copy of that permanent, except the token has "When this permanent enters the battlefield, if it's a creature, it fights up to one target creature you don't control."

[JayDi85]

Yes, it's a real troll, played 1 vs 1 game from same computer, but with two diff clients. From USA, IP address recorded too.

[JayDi85]

Another use case from a normal game with infinite game freeze on mana calculations -- only 25 permanents on battlefield, but something do an explosive {any} mana growth in available mana calculation.

It must have additional limits for such use cases.

[JayDi85]

• [x] Another interesting catch: some users was able to run macro feature (it's outdated and disabled feature to repeat same user actions on server side, e.g. combo recording). Fixed by ebaa92c537205acb27f44fa5cfc8dd85ab2345d4

[JayDi85]

Server stats from last week: ~7 restarts per day

[JayDi85]

Found two use cases for crash protection tests in old reddit’s topic: https://www.reddit.com/r/XMage/comments/ikroo7/i_love_when_i_get_spectators/

TODO:

• [ ] Must be checked and implemented as unit tests:

1 - tokens:

The main deck is OmniTell, that is: Legacy Show and Tell into Omniscience to cast stuff for free, but I've built a version that basically exists as a gun, and the ammo is whatever is in my sideboard.

So the part that crashes the client is to play Opalescence turning all Enchantments into creatures, then playing a Dual Nature to get tokens of creatures (enchantments) and Doubling Seasons to double the number of tokens. However, when Dual Nature enters the battlefield, Opalescence makes it a creature, so it triggers itself. That means there are two Dual Natures. When I play Doubling Season, two Dual Nature triggers go onto the stack, trying to each place a token copy of Doubling Season. After some number of these resolve the next Dual Nature trigger to resolve places token Doubling Seasons doubled for every other token. This makes it grow very very quickly in number, as it basically creates 2^N + N tokens for each Dual Nature trigger to resolve where N is the number of Doubling Seasons. So for two plays of Doubling Season (which is where the game lags hard and locks up) this is about 2^2059 tokens, each a 5/5 creature token copy of Doubling Season.

2 - triggers:

If one were to use this deck in real life, you can easily keep track of the number of tokens and just put some piece of paper to represent it, right?

Wrong.

I also have included in the deck Grip of Chaos, which will be copied a large number of times. Then if I were to happen to play a spell which targets a creature, ALL of those triggers go onto the stack and EACH one triggers ALL of them. In a tournament, this means you have to call over a judge to resolve them, and they would be very disappointed in me.

3 - more triggers with double season

[JayDi85]

TODO:

• [x] find and replace inner classes to static (possible memory leaks). ~50 places to fix. IntelliJ IDEA inspection settings example to find it:

[xenohedron]

TODO: find and replace inner classes to static (possible memory leaks). ~50 places to fix.

I'm starting to work on this

[xenohedron]

TODO: find and replace inner classes to static (possible memory leaks). ~50 places to fix.

Most addressed, see #11798 and #11810

[JayDi85]

TODO:

• [ ] after new facedown rework/merge: check and fix [[Vesuvan Shapeshifter]] and [[Hooded Hydra]] infinite bug from #7153, #11733

Related details:

[github-actions[bot]]

Vesuvan Shapeshifter - (Gatherer) (Scryfall) (EDHREC)

{3}{U}{U} Creature — Shapeshifter 0/0 As Vesuvan Shapeshifter enters the battlefield or is turned face up, you may choose another creature on the battlefield. If you do, until Vesuvan Shapeshifter is turned face down, it becomes a copy of that creature, except it has "At the beginning of your upkeep, you may turn this creature face down." Morph {1}{U}

Hooded Hydra - (Gatherer) (Scryfall) (EDHREC)

{X}{G}{G} Creature — Snake Hydra 0/0 Hooded Hydra enters the battlefield with X +1/+1 counters on it. When Hooded Hydra dies, create a 1/1 green Snake creature token for each +1/+1 counter on it. Morph {3}{G}{G} As Hooded Hydra is turned face up, put five +1/+1 counters on it.

[JayDi85]

• [x] Looks like java 8 under docker has some bugs and generate memory “leaks” too by inner tools like GC, native threads, etc. Maybe it will be fixed after migrate to newer java someday.

So current workaround: leave more free memory for the system and docker. Example:

• hardware: 8000 MB;
• docker’s container memory limit: 7200 MB;
• java’s app memory limit: 5500 MB.

Use follow formula:

• 800 MB for server machine tasks;
• All other memory give for docker's machine (machine memory - 800 Mb);
• Split docker memory between:
  • 700 Mb for docker;
  • 1000 Mb for java non heap memory;
  • All other memory for heap memory (xmx = docker memory - 700 - 1000);

[JayDi85]

Last crashes was due constant memory leaks without cpu usage or objects overflow. And there is a new suspect - network library with buggy finalizers (source of the some leaks). Maybe new server session code can cause it and require some fixes: #11527

• [x] ok, real problem was in GC, see below

[JayDi85]

Intermediate report after more researches and memory dumps analysing from last weeks (server with disabled AI):

1. [x] Memory leaks by games (e.g. too many game states) -- no, it's not actual any more. No freeze games, no infinite game states generation;
2. [x] Memory leaks by another code (e.g. third party library, see prev comment) -- no, it's not actual. It has some potentially leaked traces but it's too small (few KBs, not MBs or GBs);
3. [x] 100% CPU usage like infinite transform -- no, it's not actual. Transform bug exists, but real games and server can do nothing with it. There were only few use cases with high CPU usage (maybe related to transform, maybe related to another heavy calculations), but it last for few minutes without any consequences (no crashes, no memory overuse);

But I found very perspective problem:

• [x] Real memory "leaks" come from java's Garbage Collector (GC). For unknown reason GC forget to clean old gen objects and it raises by time until memory overflow (more work time -- more new gen objects moved to old gen and keeps in memory). It's not leaks. It's wrong max docker/server memory settings -- jvm/gc can't start to clean old gen objects and can't raise out of memory related errors like db crash.

Server's memory usage example:

GC works example - it ignore most of the heap (old gen objects) until manually GC call (new and old gen objects clean):

No memory leaks after manual GC call:

Here is related SO topic with possible solutions for such problem. Experiments with the server will continue. Looks like it coming to finish.

[JayDi85]

BTW server with 30 active games uses less than 500 MB after 12 hours uptime -- it's related to low hardware requirements and good/stable performance.

[JayDi85]

[JayDi85]

No more memory crashes, so server live longer to catch worse bugs like empty players list and no started games from #5358.

Real reason: infinite code freeze in string replace (!!!) and server's data lock, so all other code waiting data unlock. It's critical error and contains two independent problems.

TODO:

• [x] infinite string replacement - need research and unit tests for proof (is it possible to freeze it by some texts). Results: can't reproduce, see test_InfiniteFreezeOnStringReplace_Fast
• [ ] bad fields/class lock logic, so GameView's generating freeze can block a whole server -- need research, maybe no needs in some sync fields/methods, maybe need some copy code instead lock/sync. See additional task with richman draft below, can be related (original source of the problem).

Combo of both problems can broke whole server (no out of memory, so it must be manually restarted only):

Example of infinite freeze and 100% CPU in GainAbilityAttachedEffect with formatRule usage:

Example of infinite freeze and 100% CPU in getReminderText:

Another example with String.replace - String.indexOf:

java.lang.Thread.State: RUNNABLE
    at java.lang.String.indexOf(String.java:1503)
    at java.util.regex.Matcher.quoteReplacement(Matcher.java:701)
    at java.lang.String.replace(String.java:2240)
    at mage.abilities.costs.AlternativeCostImpl.getReminderText(AlternativeCostImpl.java:66)
    at mage.abilities.costs.AlternativeSourceCostsImpl.getRule(AlternativeSourceCostsImpl.java:93)
    at mage.abilities.AbilitiesImpl.getRules(AbilitiesImpl.java:61)
    at mage.abilities.AbilitiesImpl.getRules(AbilitiesImpl.java:49)
    at mage.util.CardUtil.getCardRulesWithAdditionalInfo(CardUtil.java:1209)
    at mage.util.CardUtil.getCardRulesWithAdditionalInfo(CardUtil.java:1197)
    at mage.cards.CardImpl.getRules(CardImpl.java:235)
    at mage.util.ManaUtil.getColorIdentity(ManaUtil.java:639)
    at mage.cards.CardImpl.getColorIdentity(CardImpl.java:858)
    at mage.view.CardView.setOriginalValues(CardView.java:1174)
    at mage.view.CardView.<init>(CardView.java:340)

After some research and tests -- 100% CPU usage related to memory overflow by big amount of triggers and other data. Latest java 8 affected by string replace freezing bug anyway. So it's still actual.

TODO:

• [ ] There were multiple RichManBoosterDraft while freeze, maybe related

It stuck at pick cards:

It can continue on player quit or submit/autosubmit only (maybe notify calls miss in some use cases/places):

[JayDi85]

Interesting game/server freeze example with wrong "synchronized" usage (unnecessary thread locks problem):

Original reason: too many mana variations bug from https://github.com/magefree/mage/issues/11285#issuecomment-1831260668, but it show up additional problems with threads lock and game updates -- if game "freeze" then users can't do anything and all requests will be freeze too.

TODO:

• [x] research "synchronized" methods and split it between "one way and read only" methods like game update (can be called from any threads) and "two way" methods with feedback waiting (must be called from game thread only). Example: GameController::informPersonal -> Game::informPlayer. Hmm. Looks like there are must be third method type: "two way with non game dialogs".
• [ ] implement player's GameView cache (refresh it on game thread usage and use last created on non-game threads like rollback requests and other, see above). Can use logic from ensureRunInGameThread method. It will helps with many potential game locks.

P.S. More details and steps to reproduce for sync lock bug. It's interesting -- game ended already (I think due concede of all players), but can't continue and finish due thread lock:

[JayDi85]

• [ ] rare ghost games problem: response waiting code can go to infinite (if all players disconnected without concede and game thread stuck on waiting someone, e.g. due network problems). Must use protection timeout to continue in game thread or must improve server health check to find and close such ghost games. There are additional threads with player timers (it can stop game on timeout) but it looks bad and must be removed someday (4 players game creates 5 threads: 1 for game and 4 for each timers -- also it execute leave code from non-game thread so it can broke it at any moment).

  "GAME fca08133-9c87-4295-8dc7-e489e80b51bb" - Thread t@8602
  java.lang.Thread.State: WAITING
  at java.lang.Object.wait(Native Method)
  - waiting on <3b530b5d> (a mage.player.human.PlayerResponse)
  at java.lang.Object.wait(Object.java:502)
  at mage.player.human.HumanPlayer.waitForResponse(HumanPlayer.java:322)
  at mage.player.human.HumanPlayer.priority(HumanPlayer.java:1316)
  at mage.game.GameImpl.playPriority(GameImpl.java:1668)
  at mage.game.turn.Step.priority(Step.java:67)
  at mage.game.turn.Phase.playStep(Phase.java:205)
  at mage.game.turn.Phase.play(Phase.java:91)
  at mage.game.turn.Turn.play(Turn.java:137)
  at mage.game.GameImpl.playTurn(GameImpl.java:1131)
  at mage.game.GameImpl.play(GameImpl.java:1038)
  at mage.game.GameImpl.start(GameImpl.java:1014)
  at mage.server.game.GameWorker.call(GameWorker.java:34)
  at mage.server.game.GameWorker.call(GameWorker.java:15)

[JayDi85]

• [ ] Infinite mana combos from mana triggers can potentially go to 100% CPU usage and crash. Must research [[Basalt Monolith]] with cards like [[Kinnan, Bonder Prodigy]] (other examples on [reddit[(https://www.reddit.com/r/mtgfinance/comments/fy1e1i/kinnan_makes_basalt_monolith_go_infinite_with/)).
• [ ] AI games also affected by it, see #10197 (not related to server crashes)

[github-actions[bot]]

Basalt Monolith - (Gatherer) (Scryfall) (EDHREC)

{3} Artifact Basalt Monolith doesn't untap during your untap step. {T}: Add {C}{C}{C}. {3}: Untap Basalt Monolith.

Kinnan, Bonder Prodigy - (Gatherer) (Scryfall) (EDHREC)

{G}{U} Legendary Creature — Human Druid 2/2 Whenever you tap a nonland permanent for mana, add one mana of any type that permanent produced. {5}{G}{U}: Look at the top five cards of your library. You may put a non-Human creature card from among them onto the battlefield. Put the rest on the bottom of your library in a random order.

[JayDi85]

• [ ] detached games problem

Each server game works in game thread (GameWorker) and must be processed from start to end by that thread. All errors must be processed inside. But some code can cause it to quit without real game finish. That's game will be detached (it will be store in active games list until server restart, but nothing works with it).

Table health check must find and delete it, but it can't -- maybe due active/connected game's players. Server example: ~2% of all games keep active.

Two possible solutions:

• good: health check must close that games;
• bad: health check must start new game thread and continue to execute that game;

It's not critical bug -- just showing that some errors/bugs occurred and must be researched.

[JayDi85]

• [ ] something miss in tourney stats: -1 in active (like detached games but for tourney?)

[JayDi85]

• [ ] client take too much time for disconnect sometime

After one of the few updates disconnect process starting to freeze sometime for 5-10 seconds for unknown reason (connect to public server, do nothing and try to disconnect). Maybe related to wrong synchronized usage on busy server from [above comments]

(https://github.com/magefree/mage/issues/11285#issuecomment-2044515400).

[JayDi85]

• [x] multiple instance of [[Energy Refractor]] cause 100% CPU usage forever, see workable test from 4e9b42a6dfa17e75c2c2ebbdedfe25c434f551fe

[github-actions[bot]]

Energy Refractor - (Gatherer) (Scryfall) (EDHREC)

{2} Artifact When Energy Refractor enters the battlefield, draw a card. {2}: Add one mana of any color.