getappmap / appmap-java

AppMap client agent for Java
Other
80 stars 14 forks source link

Agent recording performance #243

Closed kgilpin closed 7 months ago

kgilpin commented 8 months ago

On the flowable project, test case execution times are substantially longer with AppMap enabled than without it.

Comparison A

The spring-boot samples take much longer with AppMap:

Without AppMap: https://github.com/land-of-apps/flowable-engine/actions/runs/7064113146/job/19231485158#step:6:7791

With AppMap: https://github.com/land-of-apps/flowable-engine/actions/runs/7063153994/job/19228502306#step:7:7973

Comparison B

Rest Classes take much longer with AppMap:

Without AppMap: https://github.com/land-of-apps/flowable-engine/actions/runs/7064113146/job/19231485158#step:6:7775

With AppMap: https://github.com/land-of-apps/flowable-engine/actions/runs/7063153994/job/19228502306#step:7:7957

Comparison C

Flowable - Engine tests take about the same amount of time:

Without AppMap: https://github.com/land-of-apps/flowable-engine/actions/runs/7064113146/job/19231485158#step:6:7737

With AppMap: https://github.com/land-of-apps/flowable-engine/actions/runs/7063153994/job/19228502306#step:7:7919

Comparison D

Without AppMap

https://github.com/land-of-apps/flowable-engine/actions/runs/7064113146/job/19231485158#step:6:4901

[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceCollectionResourceTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.081 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceQueryResourceTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.158 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceQueryResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceResourceTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.099 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceVariableCollectionResourceTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceVariableCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemVariableResourceTest
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.166 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemVariableResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.SerializableVariablesDisabledTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.509 s - in org.flowable.cmmn.rest.service.api.runtime.SerializableVariablesDisabledTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskCollectionResourceTest
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.425 s - in org.flowable.cmmn.rest.service.api.runtime.TaskCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskIdentityLinkResourceTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.125 s - in org.flowable.cmmn.rest.service.api.runtime.TaskIdentityLinkResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskQueryResourceTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.414 s - in org.flowable.cmmn.rest.service.api.runtime.TaskQueryResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskResourceTest
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.487 s - in org.flowable.cmmn.rest.service.api.runtime.TaskResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskVariableResourceTest
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.249 s - in org.flowable.cmmn.rest.service.api.runtime.TaskVariableResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskVariablesCollectionResourceTest
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.262 s - in org.flowable.cmmn.rest.service.api.runtime.TaskVariablesCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.VariableInstanceCollectionResourceTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.152 s - in org.flowable.cmmn.rest.service.api.runtime.VariableInstanceCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.VariableInstanceQueryResourceTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.076 s - in org.flowable.cmmn.rest.service.api.runtime.VariableInstanceQueryResourceTest

With AppMap

https://github.com/land-of-apps/flowable-engine/actions/runs/7063153994/job/19228502306#step:7:5202

[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceCollectionResourceTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.478 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceQueryResourceTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.468 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceQueryResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceResourceTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.601 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceVariableCollectionResourceTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.258 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemInstanceVariableCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.PlanItemVariableResourceTest
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.462 s - in org.flowable.cmmn.rest.service.api.runtime.PlanItemVariableResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.SerializableVariablesDisabledTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.817 s - in org.flowable.cmmn.rest.service.api.runtime.SerializableVariablesDisabledTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskCollectionResourceTest
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.896 s - in org.flowable.cmmn.rest.service.api.runtime.TaskCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskIdentityLinkResourceTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.173 s - in org.flowable.cmmn.rest.service.api.runtime.TaskIdentityLinkResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskQueryResourceTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.063 s - in org.flowable.cmmn.rest.service.api.runtime.TaskQueryResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskResourceTest
[INFO] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.59 s - in org.flowable.cmmn.rest.service.api.runtime.TaskResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskVariableResourceTest
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.933 s - in org.flowable.cmmn.rest.service.api.runtime.TaskVariableResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.TaskVariablesCollectionResourceTest
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.351 s - in org.flowable.cmmn.rest.service.api.runtime.TaskVariablesCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.VariableInstanceCollectionResourceTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.313 s - in org.flowable.cmmn.rest.service.api.runtime.VariableInstanceCollectionResourceTest
[INFO] Running org.flowable.cmmn.rest.service.api.runtime.VariableInstanceQueryResourceTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.629 s - in org.flowable.cmmn.rest.service.api.runtime.VariableInstanceQueryResourceTest
appland-release commented 7 months ago

:tada: This issue has been resolved in version 1.26.0 :tada:

The release is available on:

Your semantic-release bot :package::rocket: