search

apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
823 stars 163 forks source link

Include Apple OSX support in jars in Maven central #1010

Open andygrove opened 1 month ago

andygrove commented 1 month ago

What is the problem the feature request solves?

No response

Describe the potential solution

No response

Additional context

No response

parthchandra commented 1 month ago

Do we want this in a single uber jar? It'll increase the size of the jar considerably. If we have individual jars for each platform we'll end up with a lot of combinations (we already have multiple spark + scala combinations). I have a poc using zigbuild that can simplify the building of cross platform native libs considerably so I can take this up once we decide the approach.

andygrove commented 1 month ago

I think having separate jars for linux vs Apple makes sense

andygrove commented 1 month ago

sort of related .. I think it would be best to stop publishing the fuzz test and integration test jars