apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
823 stars 163 forks source link

feat: Add ability to save protobuf plans to disk for debugging #1099

Open andygrove opened 2 days ago

andygrove commented 2 days ago

Which issue does this PR close?

Related to https://github.com/apache/datafusion-comet/issues/1098

Rationale for this change

I would like to be able to save protobuf execution plans to disk and then write benchmarks for deserializing and creating physical plans.

What changes are included in this PR?

WIP

How are these changes tested?

codecov-commenter commented 2 days ago

Codecov Report

Attention: Patch coverage is 50.00000% with 5 lines in your changes missing coverage. Please review.

Project coverage is 33.60%. Comparing base (b74bfe4) to head (4197982). Report is 6 commits behind head on main.

Files with missing lines Patch % Lines
...ain/scala/org/apache/comet/CometExecIterator.scala 16.66% 4 Missing and 1 partial :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #1099 +/- ## ============================================ - Coverage 34.33% 33.60% -0.74% + Complexity 898 866 -32 ============================================ Files 115 115 Lines 42986 42940 -46 Branches 9369 9380 +11 ============================================ - Hits 14761 14431 -330 - Misses 25361 25645 +284 Partials 2864 2864 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


🚨 Try these New Features: