Azure / azure-sdk-for-java

This repository is for active development of the Azure SDK for Java. For consumers of the SDK we recommend visiting our public developer docs at https://docs.microsoft.com/java/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-java.
MIT License
2.3k stars 1.96k forks source link

[FEATURE REQ] LIVE test for mgmt GA Lite packages #35316

Open weidongxu-microsoft opened 1 year ago

weidongxu-microsoft commented 1 year ago

Guide https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/resourcemanager/docs/HOW_TO_ADD_LIVE_TESTS.md

Sample PR (databricks) https://github.com/Azure/azure-sdk-for-java/pull/35315

Test can be very simple, just find the basic resource, create it (one can refer to samples for parameters, but it could be wrong; a better place would be Portal and its "export ARM template"), do some get/list, then delete it in finally block.

Have a pair of // @embedmeStart // @embedmeEnd enclosing the code that create a resource. Autorest.Java will extract it to README.md "Examples" section in next codegen.

Following lib would be avoided at present

PS: for shared folder, we should be able to specify another folder for bicep in "tests.mgmt.yml" e.g. https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/communication/communication-tests-template.yml#L14-L17. But better to delay it, as they are not many.

high priority

lower priority

XiaofeiCao commented 1 year ago

I'm adding test to postgresqlflexibleserver. @v-hongli1 You can leave this out.

weidongxu-microsoft commented 1 year ago

In Sept. (service may do it themselves)

v-hongli1 commented 11 months ago

Although the selfhelp service can create diagnostics, it does not have the deletion function and requires the intervention of azuer supporter. so it is recommended that the service does not add any live test cases.

v-hongli1 commented 11 months ago

The networkcloud service needs to specify an ISP provider when creating an application service, so it is recommended that the service does not add any live test cases.

weidongxu-microsoft commented 11 months ago

A few new GAed (or to be GAed) libs

v-hongli1 commented 10 months ago

The kubernetesconfiguration service needs Owner permission, but a empower exceptions occurs when deploy test resources. so it is recommended that the service does not add any live test cases. DployTestResource.log

v-hongli1 commented 10 months ago

HybridCompute needs to be used in the live test case of the HybridConnectivity service, but this front-end service can only be created through bicep, arm template or terraform. I think this way of creating front-end services is not suitable for appearing in live tests. so it is recommended that the service does not add any live test cases.

weidongxu-microsoft commented 10 months ago

Sure. Just check the box that you've added live test (in comments above).

weidongxu-microsoft commented 10 months ago
v-hongli1 commented 10 months ago

The connectedvmware service must be supported by the front-end service Kubernetes cluster with Azure Arc, but Kubernetes cluster with Azure Arc can only be created by script. This way of creating front-end services is not suitable for use in live test. So it is recommended that the service does not add any live test cases.

weidongxu-microsoft commented 10 months ago
XiaofeiCao commented 9 months ago
v-hongli1 commented 9 months ago

The azure-resourcemanager-nginx requires the use of paid azure service NGINXSaas, so it is recommended that the service does not add any live test cases.

v-hongli1 commented 9 months ago

The azure-resourcemanager-mobilenetwork service involves property settings of mobile network providers, so it is recommended that the service does not add any live test cases.

v-hongli1 commented 9 months ago

The azure-resourcemanager-confluent service requires permission to create Marketplace offer on Partner Center, so it is recommended that the service does not add any live test cases.

weidongxu-microsoft commented 8 months ago
v-hongli1 commented 3 months ago

The live test case of the service healthcareapis has been added at 2024/2/9.

v-hongli1 commented 3 months ago

The hybridcontainerservice service must be supported by the front-end service Kubernetes cluster with Azure Arc, but Kubernetes cluster with Azure Arc can only be created by script. So just leave a List (and enable that test).

weidongxu-microsoft commented 3 months ago
v-hongli1 commented 3 months ago

The resource removal method is missing in the azure-resourcemanager-support service, so it is recommended not to add any live test cases for this service.