alamb
commented
3 months ago I am starting to collect a list of things to highlight here
- New trait based APIs
- Pluggable handler for CREATE FUNCTIONL https://github.com/apache/arrow-datafusion/pull/9333 (thanks @milenkovicm)
- DataFusion Comet blog published: https://arrow.apache.org/blog/2024/03/06/comet-donation/
- Move of DataFusion to a top level Apache project was approved by the community: https://github.com/apache/arrow-datafusion/discussions/6475
- Large scale "extract scalar functions from the core" continues at good pace way https://github.com/apache/arrow-datafusion/issues/9285
Performance improvements:
-
specialized group values for strings/binary https://github.com/apache/arrow-datafusion/pull/8827
-
Meetup
-
Agenda for DataFusion meetup 2024 is looking good https://github.com/apache/arrow-datafusion/discussions/8522
-
DataFusion SIGMOD paper about DataFusion was https://github.com/apache/arrow-datafusion/issues/8373#issuecomment-1925913783
SQL to String features from @devinjdangelo / @backkem
Maybe REcursive CTEs:
- Hardening Recursive CTEs https://github.com/apache/arrow-datafusion/issues/462 with @matthewgapp and @jonahgao
Omega359
Is your feature request related to a problem or challenge?
We have had good luck writing up quarterly updates for DataFusion, most recently: https://arrow.apache.org/blog/2024/01/19/datafusion-34.0.0/
(see https://github.com/apache/arrow-datafusion/issues/6780)
Describe the solution you'd like
Write a blog post
Describe alternatives you've considered
No response
Additional context
No response