search

radius-project / radius

Radius is a cloud-native, portable application platform that makes app development easier for teams building cloud-native apps.
https://radapp.io
Apache License 2.0
1.43k stars 87 forks source link

Come up with a plan to determine what to do with cloud resources in recipes tests #6299

Open vishwahiremat opened 11 months ago

vishwahiremat commented 11 months ago

Today we use Azure recipes to have the coverage on deployment and deletion of azure resources, which takes very long time. So we want to move these tests out of functional tests to long haul testing outer loop.

AB#8841

AB#9504

youngbupark commented 11 months ago

FYI, long haul test is running the same radius binaries for 24 hours (long hours), not to run long test. long-haul test (e2e test on azure) runs the same functional test set on AKS.

Here is functional test vs e2e test on azure a.k.a long-running test.

functional test e2e test on azure
Cluster kind AKS
Radius deployment Every test from main branch every 24 hours from main branch
Monitoring No Grafana + log analytics
Test set functional test functional test

But we can selectively run the test by makefile target.

https://github.com/project-radius/radius/blob/0eae9b805a053b12f3b09779a826db8296255b18/build/test.mk#L57

willtsai commented 11 months ago

This item tracks work to come up with a plan to determine what to do with cloud resources in tests.