search

darth-veitcher / zero-to-don

0 stars 0 forks source link

Sidekiq #4

Open darth-veitcher opened 2 years ago

darth-veitcher commented 2 years ago

... yep

Need to understand how this is deployed and scaled in comparison to the main web app. Based on the docs it seems as though this is likely to be a big pain point.

Essentially runs the background tasks in a single process (albeit can do multi-thread).

darth-veitcher commented 2 years ago

Relevant thread https://ioc.exchange/@seb/109303274795016335

darth-veitcher commented 2 years ago

And another https://blog.freeradical.zone/post/surviving-thriving-through-2022-11-05-meltdown/

This guy has split the stack and spun up additional sidekiq worker images. With some adaption probably a decent starting point. Sounds like it's definitely Sidekiq that's the main bottleneck.