-
See https://github.com/rstudio/sparklyr/issues?q=is%3Aopen+is%3Aissue+label%3Ascala-interop.
Creating this issue to track and consolidate discussion, and targeting for 0.9 to make sure we get them …
-
# Reporting an Issue with sparklyr
I use sparklyr connect spark by livy, but it costs lots of time in livy_load_scala_sources, this func will load source files and execute statement one by one，can …
-
Recently, sparklyR started to support streaming queries. This is great. However, a couple of details are still unclear to me (https://stackoverflow.com/questions/55616300/sparklyr-streaming-join-with-…
-
Hi mapdeck team:
I saw `mapdeck` is a great tool to viz large-scale data, and I found [GeoSparkViz](https://datasystemslab.github.io/GeoSpark/api/viz/sql/
) is doing a similar thing, which can r…
-
sparklyr seems confused when a ``val`` is implemented on both companion object and respective class.
Here a minimal working example. Implementation on scala side:
```scala
package test
object …
-
I am using `urltools` with sparklyr and the computation is unfortunately pretty slow. I wonder if the x3 slower computation with `suffix_extract` is expected? Can I improve somehow its speed?
Thank…
-
## ORDER BY is ignored in subqueries without LIMIT
**Issue**
Sparklyr script output is filled with the same warning message (over and over again) :
_ORDER BY is ignored in subqueries without L…
-
from https://jira.apache.org/jira/browse/SPARK-23931
```
SELECT array_zip(ARRAY[1, 2], ARRAY['1b', null, '3b']); -- [ROW(1, '1b'), ROW(2, null), ROW(null, '3b')]
```
Shoot for something like
…
-
Hi, I'm using sparklyr on Databricks DBR 14+, when i would like to arrange in descending order an error occurs, ascending is fine.
Here a small example:
```r
library(magrittr)
sc %
dplyr…
-
@MilesMcBain mentioned that it is difficult to work with missing data within spark.
For example:
```r
library(sparklyr)
library(tibble)
library(dplyr)
dat