search

apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.56k stars 197 forks source link

Attempt to fix `dict_id` issue by switching from shuffle Files to shuffle Stream (files) #937

Closed avantgardnerio closed 11 months ago

avantgardnerio commented 11 months ago

Which issue does this PR close?

Closes #.

Rationale for this change

We need to support dictionaries now with v3 & JSONA.

What changes are included in this PR?

Switch from FileWriter to StreamWriter

Are there any user-facing changes?

Hopefully v3 queries work more often