exasol / integration-test-docker-environment

A docker-based environment for integration tests with the EXASOL DB.
https://exasol.github.io/integration-test-docker-environment/
MIT License
6 stars 2 forks source link

Revise validation strategy for conformance of API and CLI #342

Open ckunki opened 1 year ago

ckunki commented 1 year ago

Currently ITDE contains automated tests verifying the compatibility of API and CLI. However the current approach creates some problems.

Problem1: There are two API branches, while only the second one is verified.

lib/api/spawn_test_environment_with_test_container.py

@no_cli_function
def spawn_test_environment_with_test_container(

lib/api/spawn_test_environment:

@cli_function
def spawn_test_environment()

Problem 2: Is 100% identical interface really desired or required?

Potential situations uncovered by the current approach: