search

linkedfactory / linkedfactory-pod

The reference implementation of the LinkedFactory APIs.
Apache License 2.0
0 stars 2 forks source link

Support data import via Avro #20

Open kenwenzel opened 6 months ago

kenwenzel commented 6 months ago

The Avro file format is a compact binary format for transferring data: https://avro.apache.org/

We should consider adding Avro support als alternative to JSON and CSV at least for importing of data. In its simplest case a scheme with a flat structured record of scalar values could be used:

{"namespace": "lf.avro",
 "type": "record",
 "name": "data",
 "fields": [
     {"name": "time", "type": "long"},
     {"name": "colum1",  "type": ["string", "null"]},
     {"name": "colum2", "type": "double"}
 ]
}