search

visheshdembla / Panorama

Highly Available, Fault Tolerant Photo Sharing App
0 stars 2 forks source link

Spike Testing #201

Closed visheshdembla closed 3 years ago

visheshdembla commented 3 years ago

Spike Testing involves increasing the load on the system suddenly and observing the behaviour of the system. Need to invest in understanding how this would be achieved.

ayishacs commented 3 years ago

The goal of spike testing is to analyze the behavior of a software application when it receives extreme variations in traffic. Spike testing helps us understand an application's maximum load; it also verifies an application's recovery time between activity spikes. We can test this by setting a constant pod count. By hitting the pods with high load such as 10000, 15000, 20000 concurrent threads , we have to make a note about the actual frequency at which spikes are observed. This helps us plan and determine the infrastructure capacity during sales day such as black friday and cyber monday.

visheshdembla commented 3 years ago

please provide with updates on the spike testing as it has been two days since the last update. @ayishacs

ayishacs commented 3 years ago

The following observations have been made while spike testing panorama application:

  1. Performed a spike test by simulating large number of users via thread groups for a duration of 2 hours to analyze the system behavior under extreme load.
  2. The simulated traffic was hit on the services of panorama application and steep spikes were observed in response times with the variations of traffic over time.
  3. Observed considerable latency, reduced throughout and increase in error rate while analyzing the response for requests with time and incremental load.

This thread will be updated with further observations

ayishacs commented 3 years ago

The above observation was made for gateway wherein the error rate is 100%, which means the test is invalid. Ignore the previous results and performing stress testing again along with troubleshooting build failures for ui in jenkins

visheshdembla commented 3 years ago

Completed spike testing https://github.com/airavata-courses/Panorama/pull/214/commits/377cdcc872c3b8c92f2425419d1a8d94a9566cf9

ayishacs commented 3 years ago

Adding spike testing results with 10000 concurrent users for the application TimevsThreads10000concurrentusers ResponseTimeOverview10000concurrentusers

ayishacs commented 3 years ago

LatencyvsRequest10000ConcurrentThreadsOverTime