-
I have an EMR cluster running Livy and I'm trying to work from a local notebook using `sparkmagic`. In my notebook I have the following:
```python
#### (cell separator)
%load_ext sparkmagic.magic…
-
### Check duplicate issues.
- [ ] Checked for duplicates
### Description
In the GPU-PR #16580, @dpiparo suggested to disable a few components to speed up the non-GPU-related parts. After disabling …
-
**Dependencies:**
python 3.8.12
pyspark 3.5.0
pymilvus 2.4.1
grpcio-tools 1.60.0
protobuf 4.25.3
milvus cluster was deployed in k8s using milvus operator 0.9.13
**SparkSession setup:**
```
…
-
Hi
I'm exploring Chronos for time series. I've decided to use this [example notebook](https://github.com/intel-analytics/analytics-zoo/blob/master/pyzoo/zoo/chronos/use-case/fsi/stock_prediction_p…
mbrhd updated
8 months ago
-
After running the WriteJasonFile function in cell 12 of the Chapter 2: Designing Databricks Day One/Project: Streaming Transactions/CH2-01-Generating Records Using DBKS Labs Datagen.py notebook I get …
-
Hello,
I am new to nbconvert and am trying to get it up and running. I am trying to execute a Jupyter Notebook from the command line and have tried a few different methods each of which hits a si…
-
#### Versions
* bokeh v2.0.1
* python v3.6.8
* zeppelin v 0.8.2
* amazon-linux-ami 2018.03-release
* emr v5.28.0
* Spark v2.4.4
* Hail v0.2.32
* Chrome v80.0.3987.149
#### Observed behavior…
-
### SynapseML version
0.9.4
### System information
- **Language version** : python 3.9.12
- **Spark Version** : spark 3.3.2
- **Spark Platform** : Synapse
- **Scala Version** : 2.12.15
### D…
-
## Description of issue
When using the `pandera.pyspark` module, validation of a `DataFrameSchema` that uses `Check.str_length()` in a column level check generates `NotImplementedError`.
- [x] I…
-
I'm currently testing this in pyspark
```
df.write\
.format("org.apache.spark.sql.redis")\
.option("table", "mytable")\
.option("infer.schema", True)\
.option("spark.redis.host","someh…