Closed BjarkeTornager closed 1 month ago
I confirmed that there is no comet-git-info.properties
in the jar file when building from source based on the published instructions.
I propose that we update CometBuildInfo
to return defaut values rather than throw an exception if this file is not present.
I suspect that this is the real root cause of https://github.com/apache/datafusion-comet/issues/1012 as well
Describe the bug
I have followed the building from source guide since I am on macOS. Only difference is that I ran the build with version 3.3:
make release-nogit PROFILES="-Pspark-3.3"
.With the produced jar from the build I can run Spark with Comet fine in the terminal like this:
However, when adding comet spark to my spark config options in my own project like this:
And running a spark test using pytest, which always succeeds when not adding the comet spark configurations mentioned above, I get the following exception:
Searching in datafusion-comet source code it looks like the error comes from here.
Details of environment:
Steps to reproduce
No response
Expected behavior
No response
Additional context
No response