data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
https://data-dot-all.github.io/dataall/
Apache License 2.0
235 stars 82 forks source link

Integration tests executed on a real deployment as part of the CICD #1220

Open dlpzx opened 7 months ago

dlpzx commented 7 months ago

Is your feature request related to a problem? Please describe. I would like data.all to be tested "in reality" once it is deployed. That allows us to verify code changes on real infrastructure. It speeds up development because it increases the confidence that developers and maintainers have that a feature does not introduce bugs.

Describe the solution you'd like A way to execute locally and in a CICD pipeline tests that run against a real API of data.all.

Describe alternatives you've considered Defining the tests using pytest. Once #950 is complete we will be able to use the SDK directly to configure the test clients and the API call definitions.

Additional context Add any other context or screenshots about the feature request here.

P.S. Please Don't attach files. Add code snippets directly in the message body instead.

dlpzx commented 7 months ago

In PR #1219 the design for integration tests in AWS is introduced. In that PR only tests for Organizations are included. We slowly need to add tests for other core and modules APIs Core:

Modules. ---> they depend on core modules, it might be difficult to test them without environments