-
Tried to read a table from DataWorld to a dataframe in Spark and then tried `printSchema` on the dataframe resulted in the following error:
```
ERROR 2019-08-20T07:14:15.083 Exception in task 0.0 in…
-
Hi @Jolanrensen ,
I'm sorry toss these issues/questions at you without being able to provide much of assistance myself. I really appreciate you taking your time to help out.
We're in the progres…
-
I have set up SANSA-Stack on a Windows 10 PC and when I try to run the MinimalCalls from the ml-spark/similarity/examples directory, I get this output:
_Using Spark's default log4j profile: org/apa…
-
While trying to save Dataframe to HBase I'm getting an error
```
Caused by: java.lang.IncompatibleClassChangeError: Found class org.apache.spark.sql.catalyst.expressions.MutableRow, but interface wa…
-
### Apache Iceberg version
None
### Query engine
Spark
### Please describe the bug 🐞
23/06/06 10:24:23 WARN SparkScanBuilder: Failed to check if LessThan(status,2) can be pushed down: Cannot find…
-
We recently upgraded from the spark-solr jar 3.2.3 to 4.0.0 and upgraded our spark version to 3.1.2. Our application now runs utilizing Kubernetes instead of Yarn. Our workloads complete successfully …
-
I'm use rapids accelerator and spark-rapids-ml in conjunction and am facing below error. If rapids accelerator is disabled, it runs successfully. The documentation implies the two should be able to wo…
-
## What went wrong?
This is an inconvenience rather than a BUG per se - If one is to provide `columnStats` during appends, stats for ALL indexed columns must be present.
## How to reproduce?
Di…
-
I receive the below error when trying to use inside an Azure DataBricks notebook. After some investigation I believe the issue is when it copies the file to the local directory and then reads it aga…
-
Hello,
I'm trying to make a deployable version of torchmoji.. I'm still very new to Pyspark and I'm doing this project on Databricks.
My code:
```python
import pyspark.sql.functions as F
…