-
Collecting dataframes with date columns is about 300x slower in sparklyr 1.3 & 1.4 compared to version 1.2.
To reproduce the issue I created a temp view in spark with ~5 million rows with either a …
-
Let us suggest I have the following data
```r
sc
-
I get an error message that sparklyr and dplyr want tibble version >= 1.3.0.9001. All the methods I've tried seem to install 1.3.0 only.
-
I try to copy somewhat large (~800MB) datasets into a Spark-Dataframe for benchmarking purposes. The data consists of one column with random numbers. Everything works well with smaller datasets, but a…
PecoE updated
3 years ago
-
Hello,
It is possible to to save a cross validated model in order to do predictions?
```ml_classification_cross_validation```
Thank you
Regards
-
This is an issue that was observed as a change from sparklyr 1.0.2 to sparklyr 1.4.0
Previously, with sparklyr 1.0.2 - a connection w/ livy jars can be done this way, and a class that is contain…
ying1 updated
4 years ago
-
Hi team!
How can I modify spark_connection parameters in a runtime fashion?
For example:
`conf
-
Hi team!
Another question for you...
I'm trying to use "prophet" R package thorugh a spark environment with sparklyr. We install the package in the boot action to create the distributed Spark enviro…
-
R 语言历史 -- R 进入 4.0 时代 https://jozef.io/r921-happy-birthday-r/
-
I tried to setup `sparklyr` for big-data https://github.com/englianhu/binary.com-interview-question/blob/master/binary-Q1Inter-HFT.Rmd but failed.
```diff
> library('BBmisc')
> library('sparklyr'…