Integration tests executed on a real deployment as part of the CICD

[dlpzx]

Is your feature request related to a problem? Please describe. I would like data.all to be tested "in reality" once it is deployed. That allows us to verify code changes on real infrastructure. It speeds up development because it increases the confidence that developers and maintainers have that a feature does not introduce bugs.

Describe the solution you'd like A way to execute locally and in a CICD pipeline tests that run against a real API of data.all.

Describe alternatives you've considered Defining the tests using pytest. Once #950 is complete we will be able to use the SDK directly to configure the test clients and the API call definitions.

Additional context Add any other context or screenshots about the feature request here.

P.S. Please Don't attach files. Add code snippets directly in the message body instead.

[dlpzx]

In PR #1219 the design for integration tests in AWS is introduced. In that PR only tests for Organizations are included. We slowly need to add tests for other core and modules APIs Core:

• [X] Organizations
• [X] 1️⃣ Environments - effort:large Issue
• [X] Groups - effort:low (Part of Environments)
• [ ] 3️⃣ Permissions - effort:low
• [ ] 3️⃣ Stacks - effort:low
• [ ] 3️⃣ VPC -effort:low

Modules. ---> they depend on core modules, it might be difficult to test them without environments

• [X] 2️⃣ Notebooks - effort:medium
• [X] 2️⃣ Worksheet - effort:medium
• [ ] 1️⃣ Datasets - effort:large Issue -HALFWAY DONE
• [ ] 2️⃣ MLStudio - effort:medium
• [ ] 1️⃣ Shares - effort:large Issue
• [ ] 3️⃣ Catalog (glossaries) - effort:medium
• [ ] 2️⃣ Dashboards - effort:medium
• [ ] 3️⃣ DataPipelines - effort:medium
• [ ] 4️⃣ Feed - effort:low
• [ ] 3️⃣ Notifications - effort:low
• [ ] 4️⃣ Vote - effort:low