search

danthegoodman1 / icedb

An in-process Parquet merge engine for better data warehousing in S3
https://blog.danthegoodman.com/icedb-v2
116 stars 4 forks source link

Avro insert support #123

Open danthegoodman1 opened 2 months ago

danthegoodman1 commented 2 months ago

Can insert an avro record, which since it includes the schema, will use that schema for the insert.

It will be used both for setting initial table types, as well as type checking

danthegoodman1 commented 2 months ago

Use https://github.com/fastavro/fastavro?tab=readme-ov-file

danthegoodman1 commented 2 months ago

Inserting would need to include a kward called avro_schema to do this

danthegoodman1 commented 2 months ago

added suggestions for type forcing on insert in the README