apache / datafusion

Apache DataFusion SQL Query Engine
https://datafusion.apache.org/
Apache License 2.0
6.27k stars 1.19k forks source link

Continue to break datafusion crate into smaller crates #4181

Open alamb opened 2 years ago

alamb commented 2 years ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do. Quoting @Jimexist on https://github.com/apache/arrow-datafusion/issues/1750

It helps with code management and dependency reasoning

Also I have heard annecdotal reports that compiling datafusion takes too long / too much memory to compile which is sad.

Describe the solution you'd like

Describe alternatives you've considered Leave as is

Additional context First part of split was in https://github.com/apache/arrow-datafusion/issues/1750, driven by @Jimexist ❤️

andygrove commented 1 year ago

Sounds good to me.

alamb commented 1 year ago

I have begun this work in https://github.com/apache/arrow-datafusion/pull/5432