search

eclipse-sparkplug / sparkplug

Sparkplug
Eclipse Public License 2.0
114 stars 39 forks source link

MQTT Broker : Sparkplug Aware Test #473

Closed Mahersrasra closed 1 year ago

Mahersrasra commented 1 year ago

What do you want to know?

Hello everyone, I'm currently in the process of confirming whether my MQTT broker aligns with Sparkplug compliance. I'm encountering some uncertainty surrounding the Sparkplug awareness test. I'm unsure whether I should establish a connection to the HIVEMQ broker or utilize my own broker. I proceeded by connecting the Edge Node to my personal MQTT broker and observed the subsequent outcome. Could someone clarify the specifics of the test case and provide an explanation for the obtained results?

image

Test results with when connecting with my own broker

image

Is this related to a Sparkplug Listing request? If so, link the issue from https://github.com/eclipse-sparkplug/sparkplug.listings here.

No response

Version

3.0.0 (Default)

Accept EFTL Terms

bryce-nakatani commented 1 year ago

Thank you for reaching out.

The "NOT EXECUTED" states means that the test criteria were not evaluated. These are associated with the optional "Sparkplug Aware MQTT Server".

To find information about the Sparkplug Aware MQTT Server, take a look at section 10.1.4 in the specification https://www.eclipse.org/tahu/spec/sparkplug_spec.pdf.

If you would like to find out more about specific test criteria, search the specification for the criteria tag. For example, if you searched for "conformance-mqtt-aware-store", you'll find a tag in the specification that looks like "tck-id-conformance-mqtt-aware-store".

On Tue, Aug 15, 2023 at 3:43 AM Mahersrasra @.***> wrote:

What do you want to know?

Hello everyone, I'm currently in the process of confirming whether my MQTT broker aligns with Sparkplug compliance. I'm encountering some uncertainty surrounding the Sparkplug awareness test. I'm unsure whether I should establish a connection to the HIVEMQ broker or utilize my own broker. I proceeded by connecting the Edge Node to my personal MQTT broker and observed the subsequent outcome. Could someone clarify the specifics of the test case and provide an explanation for the obtained results?

[image: image] https://user-images.githubusercontent.com/78274224/260686684-a543c181-1588-4964-9f65-ebcfdc2c2cdb.png

Test results with when connecting with my own broker

[image: image] https://user-images.githubusercontent.com/78274224/260686581-e4579dbf-4965-4d4f-888c-a9c32b015022.png Is this related to a Sparkplug Listing request? If so, link the issue from https://github.com/eclipse-sparkplug/sparkplug.listings here.

No response Version

3.0.0 (Default) Accept EFTL Terms

  • I agree to the terms of EFTL

— Reply to this email directly, view it on GitHub https://github.com/eclipse-sparkplug/sparkplug/issues/473, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEF6AZRCLFNB7YJCIYENPNDXVNHGLANCNFSM6AAAAAA3Q42VAM . You are receiving this because you are subscribed to this thread.Message ID: @.***>

Mahersrasra commented 1 year ago

Thank you for your quick reply. I want to understand the potential implications of these test results on the acceptance of the conformance appliance. Could you clarify whether it's obligatory to successfully pass these tests for the appliance's approval? I'm particularly interested in comprehending the significance of the result labeled as "not executed" in the test outcomes.

bryce-nakatani commented 1 year ago

The Sparkplug Aware MQTT Server functionality is optional.

In a nutshell, the functionality retains birth certificates and defines a topic structure on how to subscribe to them for retrieval.

Since the feature is optional, MQTT servers that don't implement this option may still gain Sparkplug acceptance as long as the server passes the other required (must) criteria.

Admittedly, the test results can be a little overwhelming/confusing. The not executed status was to separate what was initially a boolean pass/fail. Since the specification has optional sections, they initially showed up as "fail." A third test state (not executed) was added to help clarify this situation.

My experience with the TCK (from the edge node perspective) is that if a "must" criteria fails, the TCK immediately terminates.

If you would like to see an implementation of a Sparkplug Aware add-on and evaluate it, here is a link https://github.com/hivemq/hivemq-sparkplug-aware-extension/tree/master to a HiveMQ Community extension.

On Wed, Aug 16, 2023 at 1:09 AM Mahersrasra @.***> wrote:

Thank you for your quick reply. I want to understand the potential implications of these test results on the acceptance of the conformance appliance. Could you clarify whether it's obligatory to successfully pass these tests for the appliance's approval? I'm particularly interested in comprehending the significance of the result labeled as "not executed" in the test outcomes.

— Reply to this email directly, view it on GitHub https://github.com/eclipse-sparkplug/sparkplug/issues/473#issuecomment-1680156448, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEF6AZX4PYVNRHWN3HJCX43XVR53LANCNFSM6AAAAAA3Q42VAM . You are receiving this because you commented.Message ID: @.***>

Mahersrasra commented 1 year ago

Okay thank you for being responsive