apache / datafusion-python

Apache DataFusion Python Bindings
https://datafusion.apache.org/python
Apache License 2.0
321 stars 64 forks source link

UDAF `sum` workaround #741

Closed Michael-J-Ward closed 3 days ago

Michael-J-Ward commented 3 days ago

Part of #727 Ref #730

Which issue does this PR close?

I suspect that the proper solution is to register the new UDAFs with the function registry. But I'm unsure how that machinery should work.

As a workaround for releasing 39, I explicitly match on name == "sum" and redirect to the UDAF.

Are there any user-facing changes?

They get a new NullTreatment option.

Additional Context

I am uncertain about the design choices here, so please be critical.

Even if you choose to release this for v39, let me know how to improve it for next release.