search

wandb / server

W&B Server is the self hosted version of Weights & Biases
MIT License
254 stars 21 forks source link

The weird process 'megabinary' swallows too much memory in the docker #133

Closed SwaySZ closed 8 months ago

SwaySZ commented 10 months ago

I came across with significant memory usage of the docker (Ubuntu 18.04 and wandb docker 0.44).

PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND  
3770 wandb     20   0 1641052 835976  19568 S  22.3  21.6  57:11.14 megabinary                                          
   71 wandb     20   0 2665576 667784   3480 S   0.0  17.2  65:40.84 mysqld

Not sure what the process megabinary is.

Thanks.

nate-wandb commented 10 months ago

Hi @SwaySZ, that should be the main process running the application. Is this causing any issues?

SwaySZ commented 10 months ago

Hi @SwaySZ, that should be the main process running the application. Is this causing any issues? Is there possible memory leak? The memory increases too much after several days even though I don't use the service.

nate-wandb commented 10 months ago

@SwaySZ when you say you are using wandb docker 0.44 are you referring to wandb server version 0.44.0? Upgrading to latest (0.47.2) should resolve the memory issues

nate-wandb commented 10 months ago

Hi @SwaySZ, I just wanted to follow up and see if you had a chance to try out upgrading to the latest version of wandb server and if that resolved the memory issue?

SwaySZ commented 10 months ago

Hi @SwaySZ, I just wanted to follow up and see if you had a chance to try out upgrading to the latest version of wandb server and if that resolved the memory issue?

I will take a try. Thank you.

nate-wandb commented 9 months ago

@SwaySZ of course! Did you have a chance to try this out and did it resolve the memory leak?

exalate-issue-sync[bot] commented 9 months ago

WandB Internal User commented: nate-wandb commented: @SwaySZ when you say you are using wandb docker 0.44 are you referring to wandb server version 0.44.0? Upgrading to latest (0.47.2) should resolve the memory issues

SwaySZ commented 8 months ago

WandB Internal User commented: nate-wandb commented: @SwaySZ when you say you are using wandb docker 0.44 are you referring to wandb server version 0.44.0? Upgrading to latest (0.47.2) should resolve the memory issues

This problem seems solved after upgrading. Thank you.

MBakirWB commented 8 months ago

Hi @SwaySZ , thank you for verifying the issue has been resolved. Closing this out but please feel free to reach out anytime we could be of assistance.