[RM Ch08] Compare / Align with OVP and CVC Compliance Definitions

[michaelfix]

Per 10/2 RM Ch 8 call, purpose of the issue is to close on definitions and terms of Compliance, Verification, and Validation, by comparing CNTT and CVC/OVP documentation.

Resource link: https://wiki.lfnetworking.org/pages/viewpage.action?pageId=10551934

[michaelfix]

Will assign to Trevor Cooper upon receipt of his GitHub ID.

[michaelfix]

@trevgc - please review/comment.

[trevgc]

• Latest OVP documentation links are on the OVP portal https://nfvi-verified.lfnetworking.org/#/

• OVP home on LFN site is here https://www.lfnetworking.org/OVP/

• Some definitions can be found on Wiki e.g. Testing Evolution & Strategy https://wiki.lfnetworking.org/pages/viewpage.action?pageId=10551934

• The OVP program envisages 3 types of testing:

1. Compliance: A "device" is compliant if it meets the requirements defined within a specification, i.e. a power plug is required to have 3 prongs and would be consider compliant if it indeed has 3 prongs in the correct locations and orientations. Meaning of NFVi compliance, scope of testing as well as considerations for future can be found in the OVP Program Guidelines Addendum https://opnfv-dovetail.readthedocs.io/en/latest/testing/user/ovpaddendum/index.html

• Indicates adherence of an NFV platform to behaviors defined through specific platform capabilities, allowing to prepare, instantiate, operate and remove VNFs running on the NFVI

• Compliance test cases are designated as compulsory or optional based on the maturity of OPNFV capabilities as well as industry expectations

• Test coverage and pass/fail criteria are designed to ensure an acceptable level of compliance but not be so restrictive as to disqualify variations in platform implementations, capabilities and features

2. Validation: A "device" is validated when it operated according to its intended purpose or design, i.e. a power plug is able to connect to a socket that is also known to be compliant and passes electricity, both have been validated (it really works). CVP today includes platform specific validation (Functest functional tests):

3. Performance - not currently implemented

Conformance vs compliance is not defined in CVP and previously was debated without conclusion. Recommend we avoid using "conformance" without first agreeing definition with LFN CVC.

Certification: CVP uses certification to describe the Tools and Process that allow test cases to run and results to be submitted to a repository for approval .

[michaelfix]

@markshostak @rrajesh70 - can we close this issue?

[kedmison]

As per issue #988 the cntt-gov decided to use conformance/conformant. RM changes made in PR #1208.