Cooperation with dplyrSparkSQL?

RevolutionAnalytics / dplyr-spark

spark backend for dplyr

48 stars 18 forks source link

Cooperation with dplyrSparkSQL? #26

Closed wush978 closed 9 years ago

wush978 commented 9 years ago

Dear maintainers,

I wrote a similar experimental project dplyrSparkSQL which borrows some functions from https://github.com/piersharding/dplyrimpaladb (https://github.com/piersharding/dplyrimpaladb/issues/2).

It works great in my work, so I would like to submit it to CRAN. Is it possible for us to cooperate and finish this task?

wush978 commented 9 years ago

Btw, here is the features of dplyrSpark:

Automatic installation if the user installs maven (no need to build spark)
Support filter, mutate, select and some joining functions such as left_join. I only tested the functions I used in my work.

I hope these features are attracting.

piccolbo commented 9 years ago

Maybe we should have cooperated before doing the work rather than after. What does cooperation mean now other than retiring one of the two projects? I normally do not submit my projects to CRAN because it makes it very hard to develop a serious test suite and, when external deps are present, downright impossible. There are also issues with copyright and license that would made it difficult to cooperate. So thanks, but no thanks.

wush978 commented 9 years ago

I hope the proposal is not offensive. Cooperation might be retiring my package and let me help you develop yours. Cooperation might be retiring both of our projects and build a new project since both of the projects are experimental. I prefer cooperation because it might help the community more. That's all.

I agree that it would be better if we cooperate before doing the work, but I did not know this project before.