WinVector / rquery

Data Wrangling and Query Generating Operators for R. Distributed under choice of GPL-2 or GPL-3 license.
https://winvector.github.io/rquery/
Other
109 stars 15 forks source link

Does rquery work with MonetDBLite? #5

Closed waynelapierre closed 5 years ago

waynelapierre commented 6 years ago

I have been using dplyr with MonetDBLite for a while, and it literally solves all my problems in my work. I am curious about his rquery package. My first question is what difference does it make compared to the current tidyverse ecosystem? Second, does it work with MonetDBLite?

JohnMount commented 6 years ago

rquery generates more efficient queries, has semantics more consistent with Codd's relational algebra, and performs a lot more up-front checking. Here are some notes we have on rquery. rquery hasn't been tested withMonetDBLite, so it probably would need to shaken down for that sort of application. We are mostly targeting Apache Spark and PostgreSQL at the moment (plus in-memory with rqdatatable, where again it is often much faster than dplyr).

JohnMount commented 6 years ago

I checked. rquery will need some translations define before it can work with MonetDBLite, so no it isn't ready for that database at this time. It does have a translation layer- I just have not developed the MonetDBLite translations yet (likely maybe just uppercasing some common functions). I'll add a note when I look into it. Thanks for your help.

JohnMount commented 5 years ago

Should not have closed this, sorry. I am not working on it right now, but do intend to get to this. Likely it is just changing case or synonyms for a few operators and rquery has a translation layer just for that.

JohnMount commented 5 years ago

The development version of rquery appears to work well with MonetLiteDB. Some features are different (MonetLiteDB doesn't declare sum() as a window function), but I have a non-trivial working example here.