cube2222 / octosql

OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
Mozilla Public License 2.0
4.82k stars 203 forks source link

Use gleam for distributed process #147

Closed varunshaji closed 4 years ago

varunshaji commented 5 years ago

https://github.com/chrislusf/gleam - Gleam is another go based micro-footprint framework used for MR style processing. There is a parallel thread in Gleam to implement SQL layer on top of it. It would be better if octosql could have the physical planner running on Gleam

cube2222 commented 4 years ago

We have a very specified set of qualities we need to achieve with distributed OctoSQL streaming, and I don't think we'll be able to do that with gleam.

What comes to my mind now: