datafusion-contrib / datafusion-federation

Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
Apache License 2.0
78 stars 18 forks source link

feat: barebones sub-query support #36

Closed backkem closed 6 months ago

backkem commented 6 months ago

This is a continuation of #33. cc @sardination

The PR includes barebones (see below) support for subqueries. I also tried to re-write the analyzer logic in an attempt to make it more readable.

While creating the example I realized that the current approach obviously doesn't support usage of an outer reference. (yes, making this implementation rather useless). Next steps on that topic could be:

I suggest the first point is looked into in a new PR. It's also becoming clear we'll need to look into a good way to get tests setup. For example by federating to DataFusion itself.

backkem commented 6 months ago

Closing as I overlooked the rewriting of subqueries to joins.