search

quarkusio / quarkus

Quarkus: Supersonic Subatomic Java.
https://quarkus.io
Apache License 2.0
13.76k stars 2.67k forks source link

Use dev services by default in Quarkus' own integration tests #44124

Open yrodiere opened 4 days ago

yrodiere commented 4 days ago

Description

Test modules in integration-tests rely on dedicated Maven configuration to start containers of services used in tests.

Could we not just rely on dev services for most of them?

One benefit would be additional testing of dev services in scenarios that are as close as possible to the "real world" -- as opposed to most dev service tests we have right now, which rely on QuarkusDevModeTest -- which, as great as it is, is still a simulated setup.

Another benefit in our own dev environments would be that a test failure in surefire wouldn't leave the containers running, forcing us to manually kill them before restarting the tests (I swear I had to do this many times).

A downside could be performance, as we would start the containers twice per integration test module (once for surefire tests, once for failsafe tests) instead of once. That can be worked around on CI by enabling container reuse, though then cleanup mid-build will be challenging.

Related: #43980. Which could, perhaps, have been caught if we used dev services in our integration tests. But I think the points above stand even if it's a bad example.

Implementation ideas

No response

quarkus-bot[bot] commented 4 days ago

/cc @geoand (devservices), @stuartwdouglas (devservices)

yrodiere commented 4 days ago

@stuartwdouglas (devservices)

We might want to update the bot config...

geoand commented 3 days ago

Test modules in integration-tests rely on dedicated Maven configuration to start containers of services used in tests.

For a few things there might be specific reasons why Testcontainers were not used, but I believe that most cases are just leftovers from when we didn't have DevServices

gsmet commented 3 days ago

Yeah, same here. For MongoDB, I remember we have to avoid Dev Services because we are using clustering features. But apart from that, I think we could move to Dev Services.

gsmet commented 3 days ago

Note that there's one important limitation though: Windows CI doesn't support containers. So that means we need to keep not enabling the tests and not starting dev services when containers are not enabled.

yrodiere commented 3 days ago

Note that there's one important limitation though: Windows CI doesn't support containers. So that means we need to keep not enabling the tests and not starting dev services when containers are not enabled.

Looks like an argument in favor of dev services to me: we'll need to disable the tests (same as today), but now disabling the tests will automatically disable container usage, since dev services only start when you start the tests :)