-
Please leave your review comments for our authors here.
-
Using sparklyr version 0.2.29, and sparkapi 0.3.18
On an AWS EM cluster, running the following to connect fails:
```
Sys.setenv(SPARK_HOME="/usr/lib/spark")
sc /etc/spark/conf
drwxr-xr-x 3 root roo…
-
This is with
- gensim: 0.11.1.post1
- scipy: 0.15.1
- numpy: 1.9.2
- Pyro4: 4.38
ubuntu@ip-172-31-33-28:~$ python lda_en.py
2015-07-01 01:15:42,687 : INFO : initializing corpus reader from
2015-07-0…
ghost updated
7 years ago
-
Hi,
We were happy to find this lib as we need to visualize the decision tree created using ML, but we are afraid that it cannot support the current Spark version.
We were trying multiple options i…
-
Hi,
I am trying to convert a pyspark dataframe into parquet and load into a keras model.fit using petastorm.
My dataframe schema looks like:
"field1: integer
field2: integer
....
lab…
-
# MLLib Issue整理
## 优化部分
### ADMM
[SPARK-1543](https://issues.apache.org/jira/browse/SPARK-1543)
实现了ADMM框架,依靠它可以实现很多的机器学习算法(L1-logistic regression, lasso, SVMs),
作者把这个issue关闭了,还有一些实现的细节没有讨论清楚。
除了作者的[P…
-
Hi Team (@imback82 , @Niharikadutta , @dbeavon, @suhsteve, @AFFogarty, @bamurtaugh),
Is there ever going to be a new version of this library with .Net 6.0/7.0 support? There's been no updates or a…
-
Hello everybody,
I am trying to implement XGBoost4J-Spark in a scala project. Everything works fine locally (on an intel MacBook), however when deploying to EMR, I receive the following error (runn…
-
Currently, the text protocol is very slow for large objects, we can have optional binary protocol for better performance.
-
Hello,
since support for requirements files was deprecated, there is AFAIK no way to support pinned dependencies anymore, except by putting them all into the deployment file. As I explained already…