Evalute Apache Avro as alternative for Protobuf

[kKdH]

Apache Avro is a data serialization system. Avro provides:

• Rich data structures.
• A compact, fast, binary data format.
• A container file, to store persistent data.
• Remote procedure call (RPC).
• Simple integration with dynamic languages. Code generation is not required to read or write data files nor to use or implement RPC protocols. Code generation as an optional optimization, only worth implementing for statically typed languages.

Scala

• Avro schema generation and serialization / deserialization
• Generate Scala case class definitions from Avro schemas
• An SBT plugin for automatically calling Avro code generation

  Python

• Fast Avro for Python
• Avro record class and reader generator
• Getting started with Avro and Python 3

Misc

• Thrift vs Protocol Buffers vs Avro - Biased Comparison

[kKdH]

We are going to use protobuf in favor of avro.