search

magma / domain-proxy

A Domain proxy for Magma
BSD 3-Clause "New" or "Revised" License
1 stars 6 forks source link

Domain Proxy stress testing #524

Closed hejjestemjarek closed 1 year ago

hejjestemjarek commented 2 years ago

Simulate multiple CBSDs sending requests to DP at the same time. Find element of the system that is responsible for possible failure under heavy load.

hejjestemjarek commented 2 years ago

Created test_dp_stress_test.py script that simulates X thousands CBSDs trying to concurrently send X thousands EnodebdUpdateCbsd requests. At current state of DP testing with 5k CBSDs results in Radio Controller pod being terminated with OOMKilled status due to reaching pod memory limit. Increasing pod's memory resolves the issue, but is a temporary fix and underlying issue still exists - with more CBSDs trying to concurrently update it would require more and more memory to handle these requests. Tests are to be continued on a staging environment in a new task, passed the script and knowledge to @WojSad