mesejo
commented
1 year ago Hey! I see that there is a SessionConfig in the DataFusion main repo (docs here), but I could not find a Config Class.
So I guess that to solve this issue, we need to:
- Move the methods that are present in PyConfig but not in PySessionConfig (for example, from_env)
- Mark PyConfig as deprecated (notifying users of a future deletion)
- Refactor the tests accordingly
Do we need to do anything else?
Is your feature request related to a problem or challenge? Please describe what you are trying to do. We have two different config classes, which is confusing.
Describe the solution you'd like There should be one way to set configs
Describe alternatives you've considered
Additional context