Knowledge Agent Release 23.12 Test Results Acceptance Criteria

[kelaja]

Release Test Results 23.12

Source in Catena-X Confluence and Expert Contacts here(Source only accessible for Catena-X Consortia members in current transition phase).

• [x] E2E System Integrations Tests

  • To pass the Consortia Gate 4, evidence has to be made available that all test criteria up to and including TRL 4 & TRL 6 have been achieved.
  • Expected evidence = outputs of TRL 4 and TRL 6.
  • Test Management has mapped and described all mandatory tests for Consortia Quality Gates HERE(Source only accessible for Catena-X Consortia members in current transition phase).
  • Please focus on the columns "Derived Criteria" and "Outputs"
  • Document your test results in Catena-X JIRA XRAY
  • Use the fields “DoD” and “Status” (story & solution level) to approve requirements.
  • Interim test results are required after Tests of each Sprint, this is pre-requisite to participate in E2E test phase

  Contact:

  • TEST MANAGEMENT

• [x] Approval of User Journey

  • CX Business Owner confirms: All acceptance criteria met (as defined in PI documentation) Relevant evidence is available

  Artifact Repository

  • Jira Solution Level(Source only accessible for Catena-X Consortia members in current transition phase)

  Best Practise

  • PO to obtain BO approval prior to Gate review.
  • BO therefore to evaluate progress by participation at iteration demos.
  • BOs provide E2E test cases.
  • BOs welcome to act as tester.
  • BOs expected to participate in System Demo.

  Contacts:

  • FOSS Product Owners &
  • CX Business Owners

[TomBuchertTSystems]

@bosserf Kannst du bitte die User Journey approven?

[bosserf]

ich gebe in der Rolle des BO hiermit mein Approval -> selber kann ich den Haken nicht setzen: Wer macht's?

[kelaja]

@bosserf ich übernehme 👍🏼

[drcgjung]

As discussed in yesterday's meeting and because not all test participants have Jira Access, we would document the integration and E2E tests using the following markdown table. The particpants would fill the "results" column and send their bit either as a comment to this thread or via email to @BerndRothbrust.

Knowledge Agents Integration Test Suite 23.12

Knowledge Agent Integration Test Plan "Consumer" 23.12 (ADAC)

Step	Content	Expected	Result	Status
Deploy Agent-Enabled Connector	Use OSS Helm-Chart. Use INT SSI/MIW Settings. Add OEM BPNL and Connector for synchronisation.	Two Pods/Services (Control Plane and Agent Data Plane) healthy.		[ ] Ok
Perform Remote Catalogue Request	Use OEM Connector as ProviderUrl	The asset GraphAsset?oem=BehaviourTwinReliability should have at least one offer		[ ] Ok
Check Federated Catalogue	In the agent plane log, there should be frequent synchronisation entries.	Entries associated with the OEM Connector should show "xx tuples inserted" where xx is >0		[ ] Ok

Knowledge Agent Integration Test Plan "OEM" 23.12 (BMW)

Step	Content	Expected	Result	Status
Deploy Agent-Enabled Connector	Use Self-Compiled Images From OSS Artifacts and Own Deployment Scripts. Add SUPPLIER BPNL and Connector for synchronisation.	Two Pods/Services (Control Plane and Agent Data Plane) healthy.		[ ] Ok
Perform Remote Catalogue Request	Use SUPPLIER Connector as ProviderUrl	The asset GraphAsset?supplier=BehaviourTwinRUL should have at least one offer		[ ] Ok
Check Federated Catalogue	In the agent plane log, there should be frequent synchronisation entries.	Entries associated with the SUPPLIER Connector should show "xx tuples inserted" where xx is >0		[ ] Ok
Deploy Provisioning Agent	Use OSS Images and Own Deployment Scripts. Add a reliability binding to the existing telematics database.	One Pod/Service (Provisioning Agent) healthy.		[ ] Ok
Access Provisioning Agent	Use SPARQL query to access reliabiility graph.	A non-emtpy result set should be returned.		[ ] Ok
Register Graph Asset	Publish Graph Asset along KA specification with the provisioning agent service in the dataaddress.	Registration successful.		[ ] Ok
Register Graph Policy	Publish Graph Policy along KA specification with the CONSUMER BPNL allowed.	Registration successful.		[ ] Ok
Register Graph Contract	Publish Graph Contract along KA specification with the Graph Asset in the selector and the Graph policy for access and contract.	Registration successful.		[ ] Ok

Knowledge Agent Integration Test Plan "SUPPLIER" 23.12 (ZF)

Step	Content	Expected	Result	Status
Deploy Agent-Enabled Connector	Use OSS Helm Chart	Two Pods/Services (Control Plane and Agent Data Plane) healthy.		[ ] Ok
Deploy Remoting Agent	Use OSS Images and Own Deployment Scripts. Add a behaviour/rul binding to the existing prognosis service with the remoting agent service as a callback.	One Pod/Service (Remoting Agent) healthy.		[ ] Ok
Access Remoting Agent	Use SPARQL query to access behaviour/rul graph.	A non-emtpy result set should be returned.		[ ] Ok
Register Graph Asset	Publish Graph Asset along KA specification with the remoting agent service in the dataaddress.	Registration successful.		[ ] Ok
Register Graph Policy	Publish Graph Policy along KA specification with the OEM BPNL allowed.	Registration successful.		[ ] Ok
Register Graph Contract	Publish Graph Contract along KA specification with the Graph Asset in the selector and the Graph policy for access and contract.	Registration successful.		[ ] Ok

Knowledge Agents E2E Test Suite 23.12

Knowledge Agents E2E Test Plan "CONSUMER" 23.12 (ADAC)

Step	Content	Expected	Result	Status
Register RUL skill	Post Parameterized SPARQL to Agent/Skill Endpoint under SkillAsset?consumer=RemainingUsefulLife	Registration successful.		[ ] Ok
Invoke RUL skill	Post VAN(s) to Agent Endpoint referring SkillAsset?consumer=RemainingUsefulLife	A non-empty result set should be returned.		[ ] Ok

[kelaja]

@drcgjung @BerndRothbrust kindly update, ThX

[BerndRothbrust]

OK from TM @kelaja your Task now

[dreni]

@drcgjung

Knowledge Agent Integration Test Plan "Consumer" 23.12 (ADAC)

Step	Content	Expected	Result	Status
Deploy Agent-Enabled Connector	Use OSS Helm-Chart. Use INT SSI/MIW Settings. Add OEM BPNL and Connector for synchronisation.	Two Pods/Services (Control Plane and Agent Data Plane) healthy.	control and agent plane up and running	[x] Ok
Perform Remote Catalogue Request	Use OEM Connector as ProviderUrl	The asset GraphAsset?oem=BehaviourTwinReliability should have at least one offer	offer for the GraphAsset?oem=BehaviourTwinReliability available	[x] Ok
Check Federated Catalogue	In the agent plane log, there should be frequent synchronisation entries.	Entries associated with the OEM Connector should show "xx tuples inserted" where xx is >0	in the logs, synch job showing : Found a catalog with 1 entries for remote connector https://oem.connector. Also performed local SPARQL against catalog	[x] Ok

[RohitKumar-ZF]

Step	Content	Expected	Result	Status
Deploy Agent-Enabled Connector	Use OSS Helm Chart	Two Pods/Services (Control Plane and Agent Data Plane) healthy.	control and agent plane pods and running	[x] Ok
Deploy Remoting Agent	Use OSS Images and Own Deployment Scripts. Add a behaviour/rul binding to the existing prognosis service with the remoting agent service as a callback.	One Pod/Service (Remoting Agent) healthy.	Remoting Agent pod is running	[x] Ok
Access Remoting Agent	Use SPARQL query to access behaviour/rul graph.	A non-emtpy result set should be returned.	Non-emtpy result returned.	[x] Ok
Register Graph Asset	Publish Graph Asset along KA specification with the remoting agent service in the dataaddress.	Registration successful.	Registration done	[x] Ok
Register Graph Policy	Publish Graph Policy along KA specification with the OEM BPNL allowed.	Registration successful.	Registration done	[x] Ok
Register Graph Contract	Publish Graph Contract along KA specification with the Graph Asset in the selector and the Graph policy for access and contract.	Registration successful.	Done	[x] Ok

[dreni]

Knowledge Agents E2E Test Plan "CONSUMER" 23.12 (ADAC)

Step	Content	Expected	Result	Status
Register RUL skill	Post Parameterized SPARQL to Agent/Skill Endpoint under SkillAsset?consumer=RemainingUsefulLifeE2E	Registration successful.		[x] Ok
Invoke RUL skill	Post VAN(s) to Agent Endpoint referring SkillAsset?consumer=RemainingUsefulLifeE2E	A non-empty result set should be returned.		[x] Ok

NOTE: E2E test Executed between ADAC, Knowledge-Agent Dev Environment as OEM and ZF.