search

paradigmxyz / cryo

cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes
Apache License 2.0
1.17k stars 106 forks source link

Keep eyes on Delta #85

Open MRabenda opened 1 year ago

MRabenda commented 1 year ago

Keep open eyes on Delta - following https://github.com/delta-io/delta/releases/tag/v3.0.0

The Delta Kernel project is a set of Java libraries (Rust will be coming soon!) for building Delta connectors that can read (and, soon, write to) Delta tables without the need to understand the Delta protocol details).

sslivkoff commented 1 year ago

what use case do you have in mind for delta?

writing vanilla delta files is something cryo will do once polars has a rust implementation

but writing updates to files is probably out of scope for cryo