search

apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.39k stars 181 forks source link

Use StreamWriter instead of FileWriter #943

Closed avantgardnerio closed 6 months ago

avantgardnerio commented 6 months ago

Which issue does this PR close?

Closes #942.

Rationale for this change

Described in issue, but also dictionaries don't work properly when using FileWriter (there are duplicate dictionary ID errors).

What changes are included in this PR?

Switch from FileWriter to StreamWriter

Are there any user-facing changes?

Dictionaries should work.