-
# Brief Description
I would like to know if there are any interest to create pyjanitor for pyspark? I'm using pyspark a lot and I would really like use custom method chaining to clean up my ETL…
zjpoh updated
5 years ago
-
When trying to connect to Spark using `spark_connect` with the latest development version of sparklyr we're getting the following error:
```
> sc rlang::last_error()
message: `nm` must be `NUL…
-
**Describe the bug**
Cells won't run in sequence using run all feature or selecting multiple cells using shift.
**To Reproduce**
1. Copy and paste this code in a cell:
```
i = 0
def print_iter…
-
Just checked out @nwstephens's [talk](https://www.youtube.com/watch?v=oItFZfzqqMY) at Spark Summit East where he answers some questions regarding sparklyr vs. SparkR towards the end. I've been thinkin…
-
Hello. I have encountered a recurrent bug whenever I try to create an R notebook in Jupyter using the r-essentials package installer via conda. The problem is that the kernel immediately dies.
I foll…
-
-
### Actual Behavior
numpy cannot be imported exclude in anaconda prompt, in other shell like cmd or powershell, it throw an import error as:
C:\Users\someone\AppData\Local\Continuum\minicond…
-
Hi . I try to start with graphframe . My code is
```
library(graphframes)
library(sparklyr)
library(dplyr)
# connect to spark using sparklyr
sc
-
With the dev version of dplyr installed (4/15/2017, 0.5.0.9002 commit d7d2f10167b4ac919e876eb9a891fd53345be985) the CRAN version of sparklyr (4/15/2017, 0.5.3 ) will not load:
```r
library("spar…
-
Is there a way to set up the sparklyr spark context using a pre-existing `sc` from sparkR?