SeleniumHQ / docker-selenium

Provides a simple way to run Selenium Grid with Chrome, Firefox, and Edge using Docker, making it easier to perform browser automation
http://www.selenium.dev/docker-selenium/
Other
8k stars 2.51k forks source link

[🐛 Bug]: High level of Workload memory usage #2336

Open EvgenyMarchuk opened 3 months ago

EvgenyMarchuk commented 3 months ago

What happened?

Hi all! I have been trying to deploy selenium grid via helm chart v0.33.0 and noticed high level of workload memory usage. In this case, azure runs autoscaling and adds a second machine to kubernates when we run tests.

I loaded selenium using kubernates helm chart by changing the following parameters:

kubernates version 1.29.5 chart 0.33.0 selenium images latest

It's probably not a defect, but I need to figure out what's going wrong. Thanks!

Command used to start Selenium Grid with Docker (or Kubernetes)

helm install selenium-grid docker-selenium/selenium-grid --set isolateComponents=true

Relevant log output

no logs

Operating System

Kebrnates(Azure)

Docker Selenium version (image tag)

latest

Selenium Grid chart version (chart version)

0.33.0

github-actions[bot] commented 3 months ago

@EvgenyMarchuk, thank you for creating this issue. We will troubleshoot it as soon as we can.


Info for maintainers

Triage this issue by using labels.

If information is missing, add a helpful comment and then I-issue-template label.

If the issue is a question, add the I-question label.

If the issue is valid but there is no time to troubleshoot it, consider adding the help wanted label.

If the issue requires changes or fixes from an external project (e.g., ChromeDriver, GeckoDriver, MSEdgeDriver, W3C), add the applicable G-* label, and it will provide the correct link and auto-close the issue.

After troubleshooting the issue, please add the R-awaiting answer label.

Thank you!

VietND96 commented 3 months ago

Hi, thanks for your report. Can you also provide the cluster capability (CPU, memory) used?

EvgenyMarchuk commented 3 months ago

Standard_E8as_v4(8 cores/64Gb memory) Standard_D8as_v4(8 cores/32Gb memory) and v5 version with 8 cores and 64Gb memory After deploying the workload, memory usage has increased by more than 35% over 35% of availabel memory, but usage is around 10%. You can find some information on the attached pictures. The behavior is the same for different clasters/machines. Big eaters Distributor, Router, SessionQueue.

image image image

VietND96 commented 3 months ago

Looks like it relates to this https://github.com/SeleniumHQ/docker-selenium/issues/2312 - Distributor is a component in part of Hub (in Hub-Node mode) As per comment, there is a fix in Nightly build. If have time, can you refresh the setup with image tag nightly for all components and evaluate this? Then we can have fast feedback if anything can be fixed further

EvgenyMarchuk commented 3 months ago

If I'm not mistaken, I had the same issue I'll check it out!

EvgenyMarchuk commented 3 months ago

There is some Error when I install 0.33.0 version of helm chart. Error without description image

After upgrade nightly, workload memory usage is the same high image image