search

iree-org / iree-llvm-sandbox

A sandbox for quick iteration and experimentation on projects related to IREE, MLIR, and LLVM
Apache License 2.0
52 stars 30 forks source link

[Substrait] Add test that executes exported plan in DataFusion. #823

Closed ingomueller-net closed 4 months ago

ingomueller-net commented 5 months ago

This PR adds an end-to-end test with Apache DataFusion, an Arrow-based SQL execution engine that can consume Substrait plans. This illustrates how our Substrait plans can run on different engines and provide a base for more complete compatibility tests, which we may want to do at some point down the road.

ingomueller-net commented 4 months ago

Noob question: what is DataFusion? :) (the check result here looks the same as previous one so don't know what roles which do)

Good question! I did what I probably should have done from the start: write the rationale in the PR description/commit message. (In short: DataFusion is another Substrait consumer, so this tests illustrates the portability of Substrait.)