search

fediverse-devnet / feditest

A testing framework for distributed, heterogeneous systems communicating with complex protocols, such as the Fediverse
https://feditest.org/
MIT License
30 stars 5 forks source link

Reporting: Skipped Test #146

Closed steve-bate closed 2 months ago

steve-bate commented 3 months ago

Was the parameter_ordering test skipped mostly for report generation testing purposes? It seems like a test like this shouldn't be included in the report. It makes sense that a Node might raise this exception, but we should require a description/reason for skipping (maybe it's a bug, maybe it's intentional, ...).

In the future, the framework might skip tests if we have a capabilities model, the test is associated with required capabilities, and we know the server(s) being tested don't have that capability.

jernst commented 2 months ago

The parameter_ordering test being not fleshed out was just me being lazy. Sorry.

Also https://github.com/fediverse-devnet/feditest/pull/151