-
HI -
https://spark.rstudio.com/guides/extensions.html lists mmlspark as a Sparklyr extension. Recently, the name of this project was changed from mmlspark to SynapseML. The old link for its Sparkl…
-
### Checklist
- [X] I added a descriptive title
- [X] I searched for other issues and couldn't find a solution or duplication
- [X] I already searched in Google and didn't find any good information o…
-
In https://github.com/tidyverse/tidyr/pull/1287 we updated `names_ptypes = list()` and `values_ptypes = list()` to instead have default values of `NULL` and accept a single empty ptype as the ptype th…
-
Hi team!
I'm interested to build a UDAF function in scala (basically calculating the mode) and import in sparklyr.
I've already create a UDF by create and extension with sparklyudf framework, but fo…
-
## The problem
I'm having trouble with attempting to use `rsample::rolling_origin` within the `sparklyr::spark_apply` framework. The error generated appears to be related with how `rsample::rollin…
-
relate to https://github.com/r-spatial/sf/issues/699, I've found spark + geomesa + hbase + kafka could be a good tech stack for sparksql style processing data like sf on dplyr.
Currently, geomesa s…
-
# Reporting an Issue with sparklyr
For general programming questions with `sparklyr`, please ask on
[Stack Overflow](http://stackoverflow.com) instead.
Please briefly describe your problem and,…
-
There doesn't seem to be any way to read Avro files in Spark 2.4. This version is supposed to be able to read Avro files natively now (without needing any extensions). The `chezou/sparkavro` package i…
-
spark and scala versions in ```java/sparkhello-%s-%s.jar``` in spark_dependencies method causing classpath issues
---
I am trying to build extension for sparklyr,
in spark_compile if i specify jar…
-
I know that K-Medoids models [ PAM(smaller data)/CLARA(bigger data)] are extentions to k-means clustering models , and are used when data is subject to noise n outliers . I know how do use them in R s…