-
**Describe the bug**
The pyspark kernel worked fine in Conda jupyter notebook, but it is not showing in the vs code jupyter kernel list. But I can use %%spark to connect my livy service and run code …
-
On creating a new notebook with either Spark or PySpark kernels on a CentOS 7 machine, this error appears and kernel never starts,
```[I 11:16:51.162 NotebookApp] Kernel started: 82b4f257-29f9-46bb-8…
-
### SynapseML version
Installation issue
### System information
- **Language version** (python 3.7, scala 2.12.10):
- **Spark Version** ( 3.1.2):
- **Spark Platform** (pyspark):
Currently …
-
We tried the below code for POC:
```
_from pyspark.sql import SparkSession
spark = (SparkSession.builder.master('local').appName('openlineage_spark_test')
.getOrCreate())
spark.sparkContext.s…
-
Hi I am trying to use the featuretoolsOnSpark on my server. In trial run i am implementing the example as shown in the repo. It throws KeyError on calling "ts.table_from_dataframe"
I imported the cs…
-
Hello,
I been searching in google for a couple of hours now but I cant find a workaround this error. I'm trying to use DockerOperator for airflow.
DAG:
```from airflow import DAG
from airflow…
-
Hello-
I am trying to use your package to parse a bunch of .gdb databases that are in S3 (the same AIS ship data as in your example) and write them to a new S3 bucket using parquet so that I can p…
-
Hi, I'm using spark inside docker stack named "hadoop2" which has docker services:
1) **namenode** (mode: replica 1)
2) **datanode** (mode: global)
3) **resourcemanager** (mode: replica 1)
4) **no…
-
**What is your question?**
I am currently running [PySpark data processing jobs](https://github.com/KubedAI/spark-rapids-on-kubernetes/blob/main/examples/benchmarks/benchmark/spark-rapids-benchmarks.…
-
I am attempting to move a large amount of data using Spark/JDBC to insert to a single cstore_fdw table. I am attempting to execute many concurrent COPY commands. It appears each one gains a lock on …