apache / datafusion-python

Apache DataFusion Python Bindings
https://datafusion.apache.org/python
Apache License 2.0
376 stars 78 forks source link

Support for generating JSON formatted substrait plan #508

Open richtia opened 1 year ago

richtia commented 1 year ago

A few other substrait producers are able to generate a JSON formatted substrait plan (Isthmus, DuckDB). It would be nice if datafusion could do this as well. It would make it much easier to compare the generated substrait plans.

EpsilonPrime commented 7 months ago

One alternative would to be to use the protobuf json_format package to export/import the JSON.

mbrobbel commented 7 months ago

The substrait crate supports the Protobuf JSON Mapping via the serde feature: https://docs.rs/substrait/latest/substrait/#serde-support.