search

camunda / camunda

Process Orchestration Framework
https://camunda.com/platform/
3.33k stars 605 forks source link

Performance drop on 0.24.3 release candidate #5300

Closed deepthidevaki closed 4 years ago

deepthidevaki commented 4 years ago

Description

Average throughput is smaller on a benchmark running 0.24.3-rc1 compared to snapshot. Processing latency is also higher on average.

image

image

image

deepthidevaki commented 4 years ago

Reverting #5244 resulted in much higher throughput, comparable to benchmarks running on snapshot.

image image image

deepthidevaki commented 4 years ago

@npepinpe FYI The PR for fixing compatibility between 0.24 and 0.25 had performance impact. So we temporarily reverted it for the patch release. So 0.24.3 won't be compatible with 0.25. We should revisit #5244 before 0.25.0 release.

MiguelPires commented 4 years ago

I'm trying to reproduce this performance drop but I'm not seeing it after a few hours of running the benchmarks. Did it take a while for the degradation to become apparent or was it always slow? @deepthidevaki

deepthidevaki commented 4 years ago

@MiguelPires It was always slow. I restarted the cluster a couple of times, but the results were same.