apache / datafusion-python

Apache DataFusion Python Bindings
https://datafusion.apache.org/python
Apache License 2.0
323 stars 64 forks source link

Support for generating JSON formatted substrait plan #508

Open richtia opened 9 months ago

richtia commented 9 months ago

A few other substrait producers are able to generate a JSON formatted substrait plan (Isthmus, DuckDB). It would be nice if datafusion could do this as well. It would make it much easier to compare the generated substrait plans.

EpsilonPrime commented 3 months ago

One alternative would to be to use the protobuf json_format package to export/import the JSON.

mbrobbel commented 3 months ago

The substrait crate supports the Protobuf JSON Mapping via the serde feature: https://docs.rs/substrait/latest/substrait/#serde-support.