-
It would be great to have the Runner class represented in the Python package as well in order to apply multiple checks to multiple reporters at once in PySpark.
-
As discussed with @mnrozhkov and @tapadipti, it would be great if MLEM would somehow simplify model application within Airflow DAGs. Two questions to start with:
1. We can create something like MLEMO…
-
Thanks for the great package. Is there a plan to implement/integrate the SHAP method in PySpark?
Of, if possible, what would be your suggestion to use this technique in Spark?
thanks,
Richard
-
User reports that in `yarn` and using `sparkR` one can specify `spark.driver.memory`:
```r
sparkR.session(
master="yarn",
appName="app-name",
sparkHome="/usr/lib/spark",
sparkConfig =l…
-
### SynapseML version
0.10.2
### System information
- **Language version** (e.g. python 3.8, scala 2.12): Python 3.7.4
- **Spark Version** (e.g. 3.2.3): 3.0.0
- **Spark Platform** (e.g. Syn…
-
i had write some code to consume kafka stream data, but got error
following is my raydp code
```python
import ray
import raydp
ray.init()
packages = "org.apache.spark:spark-sql-kafka-0-10_2.12…
-
Can xgboost model of spark training be analyzed with shap?
The current error is' pipelinemodel 'object has no attribute'_ java_ obj'
-
I tried to use pyspark to do a count task.
The task was sent to spark, however, the …
-
The parameters for mmlspark are written in camelCase whereas the LightGBM parameters are written in snake_case. See: https://lightgbm.readthedocs.io/en/latest/Parameters.html
In addition, the paramet…
-
I've been working on a new Pyspark JupyterLab build and was testing extension support one at a time using the Docker container `quay.io/jupyter/pyspark-notebook:x86_64-spark-3.5.0`. I installed the `s…