search

Hyperfoil / Horreum

Benchmark results repository service
https://horreum.hyperfoil.io/
Apache License 2.0
34 stars 30 forks source link

Intermittent tests failures for ActionServiceTest.testSlackAction #1636

Closed johnaohara closed 2 months ago

johnaohara commented 4 months ago

Describe the bug

I am seeing intermittent test failures for ActionServiceTest.testSlackAction() on my machine

[ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.607 s <<< FAILURE! -- in io.hyperfoil.tools.horreum.svc.ActionServiceTest
[ERROR] io.hyperfoil.tools.horreum.svc.ActionServiceTest.testSlackAction(TestInfo) -- Time elapsed: 0.268 s <<< FAILURE!
org.opentest4j.AssertionFailedError: Test case BADCHANNEL failed ==> expected: <1> but was: <0>
    at org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
    at org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
    at org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)
    at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:150)
    at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:563)
    at io.hyperfoil.tools.horreum.svc.ActionServiceTest.testSlackAction(ActionServiceTest.java:149)
    at java.base/java.lang.reflect.Method.invoke(Method.java:568)
    at io.quarkus.test.junit.QuarkusTestExtension.runExtensionMethod(QuarkusTestExtension.java:1013)
    at io.quarkus.test.junit.QuarkusTestExtension.interceptTestMethod(QuarkusTestExtension.java:827)
    at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
    at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
johnaohara commented 3 months ago

Another error that keeps occurring is;

[INFO] 
[INFO] Results:
[INFO] 
Error:  Errors: 
Error:    ActionServiceTest.testSlackAction:128 » ArcUndeclaredThrowable Error invoking subclass method
[INFO] 
Error:  Tests run: 236, Failures: 0, Errors: 1, Skipped: 2