search

zeek / broker

Zeek's Messaging Library
https://docs.zeek.org/projects/broker
Other
64 stars 28 forks source link

Use safe data format for writing data to backends #161

Open Neverlord opened 3 years ago

Neverlord commented 3 years ago

As outlined in https://github.com/zeek/broker/pull/160, Broker currently serializes data using caf::binary_serializer and caf::binary_deserializer in its backends. This is unsafe, because the binary format may change between CAF releases. This means any CAF upgrade may break the persistent state of Broker.

We can either avoid binary formats in the first place, e.g., by using JSON, or we should implement a custom serializer and deserializer with a data format that Broker controls. That would also enable us to embed versioning information.

Neverlord commented 3 years ago

This may become obsolete if we switch to a memory-mappable message representation.