openBackhaul / ApplicationLayerTopology

Consolidates interface and forwarding information of the application layer
Apache License 2.0
3 stars 8 forks source link

Testexecution PostTermination mismatch in the initial and final configuration file for software upgrade #423

Open IswaryaaS opened 1 year ago

IswaryaaS commented 1 year ago

Assertion failure details In ALT software upgrade test-suite , following are the assertions that are failed because of this problem,

  1. Provides expected properties in configuration class for 'alt-2-0-1-op-s-bs-000'
  2. Provides expected properties in configuration class for 'alt-2-0-1-op-s-bs-001'
  3. Provides expected properties in configuration class for 'alt-2-0-1-op-s-bs-002'
  4. Provides expected properties in configuration class for 'alt-2-0-1-op-s-bs-003'
  5. Provides expected properties in configuration class for 'alt-2-0-1-op-s-bs-004'
  6. Provides expected properties in configuration class for 'alt-2-0-1-op-s-bs-005'
  7. Provides expected properties in configuration class for 'alt-2-0-1-tcp-s-000'
  8. Provides expected length of client-ltp list for 'alt-2-0-1-http-c-es-1-0-0-000'
  9. Provides expected properties in configuration class for 'alt-2-0-1-tcp-c-nr-2-0-1-000'
  10. Provides expected properties in configuration class for 'alt-2-0-1-op-c-bm-ro-2-0-1-000'
  11. LTP instance 'alt-2-0-1-op-c-im-cc-1-0-0-004' could be found
  12. LTP instance 'alt-2-0-1-http-c-cc-1-0-0-000' could be found
  13. LTP instance 'alt-2-0-1-tcp-c-cc-1-0-0-000' could be found
  14. Provides expected number of fc-port instances '12' in forwarding-construct
  15. Provides expected number of fc-port instances '11' in forwarding-construct
  16. Fc-port of local-id '207' could be found in actual
  17. Provides expected number of fc-port instances '3' in forwarding-construct

Reason : In the test execution, the expectation is , the initial configuration file should match the final configuration. But there is a mismatch. This mismatch are consequences of the failures of other assertions. Once the other assertion failures will be resolved , this shall also be cleared. (Because expected 'Operation key not yet provided.' to equal 'n.a.' 1 to 6 failed)

Ref : #461

PrathibaJee commented 3 months ago

Since the v2.1.1 doesn't have test suite to validate the failure mentioned in the test execution we cannot validate and close this issue for now. So, moving this to the next release.