bug: SDK test framework tries to run non-Infrahub tests

[gmazoyer]

Component

Python SDK

Current Behavior

The SDK test framework is gathering tests from the root of a repository which means that if a user defines tests, which are not Infrahub related tests, they will get collected and be run as part of the test sessions.

This behaviour can, in the best case scenario create user confusion, and in the worst case scenario make the test session fail.

Expected Behavior

Only tests defined as Infrahub tests should be run, other tests should be ignored from collection.

Steps to Reproduce

• Add a repository to Infrahub
• Define tests in directory that can be interpreted by pytest
• Observe test being run via CLI or when creating a proposed change

Additional Information

No response

[gmazoyer]

I'm not sure we can really fix this. It looks like tests are being collected by pytest without the capability to exclude them before parsing. The only thing we could do is to force Infrahub tests to be located in a specific directory in user repos and run the test pipeline against that directory.