-
Hi. I'm following the instructions from "SparklyR on Azure with AZTK", but gets an error when I run:
aztk spark cluster create --id testsparkclust4 --size 2
Error: Toolkit doesn't have an attribut…
-
Hi RasterFrames team:
Wish rasterframes could support [sparklyr](https://spark.rstudio.com) R package for more data scientists, and integrate well with [stars](https://github.com/r-spatial/stars…
-
### とは?
- RからSparkをバインディングしてdplyr記法等を利用し、使いやすいRのインタフェースを提供する
- 公式サイトを読んだ印象では、dplyr, MLib等でSparkの各種操作をラッピングして使いやすくしてるのがわかる
- XGBoostをSparkでするためのsparkxgbとやらもある
### 接続
* `sparklyr::spark_connect`
…
-
Wondering if DALEX will play nicely with sparklyr or if we can get this kind of information out of models & data in spark?
-
Hi future team,
I found future is a great framework for distributed data processing. sparklyr::spark_apply is doing the similar things , which support local mode/ yarn-client/ yarn-cluster mode.
…
-
While trying to fix the integration tests for 2.1 and 2.2 for mlvm and horovod, cluster creation fails as there are some dependency issues between torch, torchvision and torchaudio
For mlvm trying …
-
I am trying to connect to a databricks cluster and trying to run the exploratory command to list databases with `src_databases(sc)`. Not sure but wanted to reach out for thoughts on what could be goin…
-
Hello! This is potentially more of a feature request, but I was wondering whether the following two ideas are possible today and, if not, whether you would be open to the changes. For context, they …
-
-
Add support for Spark ML clustering using [`sparklyr::ml_kmeans()`](https://spark.rstudio.com/packages/sparklyr/latest/reference/ml_kmeans.html) , [`sparklyr::ml_bisecting_kmeans()`](https://spark.rst…