interuss / monitoring

InterUSS Platform USS monitoring tools for federated UTM, including automated testing.
Apache License 2.0
12 stars 19 forks source link

[rid-prober] migrate prober logic entirely to uss_qualifier scenarios, then remove prober #744

Closed Shastick closed 2 months ago

Shastick commented 3 months ago

We (progressively) want to retire the current prober entirely.

Before doing so, we need to ensure that everything it tests is also being tested by uss_qualifier scenarios.

We will do so step-wise, starting with the part of the prober that tests the remote ID part of the standards.

Gap Analysis

The following gap analysis is based on both the older InterUSS Backlog as well as a manual check of the prober files and their corresponding qualifier scenarios for RID.

In summary, the qualifier covers at least what the prober is covering with respect to both Remote ID standards v1 and v2.

prober file qualifier scenarios comments migrated
v1/test_isa_expiry.py ISAExpiry
v2/test_isa_expiry.py ISAExpiry
v1/test_isa_simple.py ISASimple
v2/test_isa_simple.py ISASimple
v1/test_isa_simple_heavy_traffic_concurrent.py HeavyTrafficConcurrent qualifier covers both v1+v2
v1/test_isa_validation.py ISAValidation
v2/test_isa_validation.py ISAValidation
v1/test_subscription_isa_interactions.py ISASubscriptionInteractions
v2/test_subscription_isa_interactions.py ISASubscriptionInteractions
v1/test_subscription_isa_slightly_overlapping.py ISASubscriptionInteractions qualifier scenario covers both v1+v2, and checks for subscriptions slightly overlapping the ISA
v1/test_subscription_simple.py SubscriptionSimple
v2/test_subscription_simple.py SubscriptionSimple
v1/test_subscription_validation.py SubscriptionValidation
v2/test_subscription_validation.py SubscriptionValidation
v1/test_token_validation.py TokenValidation
v2/test_token_validation.py TokenValidation

It should be noted that until https://github.com/interuss/dss/pull/1045 is merged on the DSS repo, the DSS CI will not be running the qualifier as part of the automated tests.

https://github.com/interuss/dss/pull/1066 adds mentions and pointers to the qualifier to the DSS doc