Flaky schemathesis tests on API endpoints with `authzed` checks

SwissDataScienceCenter / renku-data-services

Services that handle reading and writing data from a database

Apache License 2.0

3 stars 2 forks source link

Flaky schemathesis tests on API endpoints with `authzed` checks #231

Closed leafty closed 4 months ago

leafty commented 5 months ago

Schemathesis tests can be flaky for API endpoints which query permissions. I suggest listing them as slow endpoints.

Panaetius commented 4 months ago

we should change it so times are aggregated across all endpoint and then p90 has to be below a threshold, that should be a lot less flaky and actually make it so it tests something more realistic