Tracking ticket for data format validation in tremor

[darach]

Describe the problem you are trying to solve

As tremor is data format agnostic we currently do not have features that support validation against a particular external format outside of builtin support in serialization and deserialization libraries.

So data that is parsable or well formed can be transported by tremor.

For some environments validation support would be preferable:

• A connector receiving json data wishes to conform to avro or json-schema
• A json codec that only accepts valid data given a schema of some description
• Functions/operators in tremor's processing DSL that support validation

This ticket is a tracking ticket to gauge interest and what kind of support would be desirable in tremor - for what use case - and for what purpose.

Describe the solution you'd like Please add your use case and preferred solution here dear readers!

Notes

This is a tracking ticket to capture interest in possible future enhancements to tremor. If you found this ticket and would like data format validation support, please comment accordingly so we have a record of interest!

[scudellari]

I'll take a stab at this

[darach]

Let us know if you need any help on the discord 🥳

[Licenser]

2351 will ave avro and integration with the kafka schema registry