apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

https://datafusion.apache.org/ballista

Apache License 2.0

1.42k stars 183 forks source link

Refine create_datafusion_context() #778

Closed yahoNanJing closed 1 year ago

yahoNanJing commented 1 year ago

Which issue does this PR close?

Closes #777.

Rationale for this change

It's very easy for the hard-coded way of the datafusion configuration names to introduce inconsistency. And it's also lack of extensibility. Thanks to https://github.com/apache/arrow-datafusion/pull/6111, now we are able to directly leverage the from_string_hash_map to create an initial SessionConfig.

What changes are included in this PR?

Are there any user-facing changes?

yahoNanJing commented 1 year ago

Hi @andygrove and @thinkharderdev, could you help have a check?