search

kestra-io / kestra

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
https://kestra.io
Apache License 2.0
7.58k stars 462 forks source link

Flaky tests #1257

Open brian-mulier-p opened 1 year ago

brian-mulier-p commented 1 year ago

Expected Behavior

Tests should be stable and should either pass or fail all the time on a given commit

Actual Behaviour

Some tests are flaky and result in a non-stable build and having to relaunch these all over.

Steps To Reproduce

Run any test

Environment Information

CI

Example flow

Flaky tests (non-exhaustive) : io.kestra.core.serializers.JacksonMapperTest ✘ json() io.kestra.core.tasks.DockerBashTest ✘ useInputFiles() io.kestra.runner.h2.H2FlowListenersTest ✘ all() io.kestra.runner.mysql.MysqlMultipleConditionStorageTest ✘ expiration() io.kestra.runner.postgres.PostgresRunnerTest ✘ pauseRun() io.kestra.runner.mysql.MysqlRunnerTest ✘ pauseRun()

See this build for eg. logs_5800.zip

loicmathieu commented 1 year ago

Other tests that are flaky: io.kestra.core.runners.RestartTest ✘ restartFailedThenFailureWithLocalErrors() io.kestra.core.schedulers.SchedulerConditionTest ✘ schedule()

loicmathieu commented 1 year ago

Another one: io.kestra.webserver.controllers.ExecutionControllerTest ✘ restartFromLastFailed()

loicmathieu commented 1 year ago

Another one: io.kestra.runner.mysql.MysqlRunnerTest ✘ withFailedTemplate()

moadibfr commented 11 months ago

I had several failure with: io.kestra.ee.runner.kafka.KafkaRunnerTest ✘ skipExecution()

loicmathieu commented 11 months ago

io.kestra.core.tasks.flows.WorkingDirectoryTest ✘ initializationError