-
It would be nice to either support [Spark Connect](https://spark.apache.org/docs/latest/spark-connect-overview.html) server natively within the Spark operator or at least provide a tutorial to on how …
-
**Details:**
We run Spark on EMR with OpenLineage and we saw logs of:
```
pool-37-thread-1" #106 prio=5 os_prio=0 tid=0x0000ffffa1073000 nid=0xc8 waiting for monitor entry [0x0000fff71f7d2000]
…
-
### Missing functionality
After databricks runtime 14, the dataframe type is changed in notebook. It was `pyspark.sql.dataframe.DataFrame`, but now it is `pyspark.sql.connect.dataframe.DataFrame`
…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/linkis/issues) and found no similar feature requirement.
### Problem Description
目前ECM容器化后，在使用spark引擎时可能会有以下…
-
### Description
it looks from the driver that you support spark 2 and hadoop 1.2 which is very old and out of date.
### DBeaver Version
Community Version 24.2.0.202409011551
### Operating…
-
We were testing the schema validation with the Databricks connection, and we found a problem with partitioned tables.
SODA uses the columns # Partition Information and # col_name for the validation (…
-
-
Installing JAR libraries from initScript and then apache-sedona 1.6.0 or 1.6.1 makes imposible to execute any notebook. throwing the error
Failure starting repl. Try detaching and re-attaching the …
-
See https://filscan.io/en/message/bafy2bzacebf2zuwngr7xj7kalkydegswappnpgtx633l7ngask56grflxmv2u/
-
Hello Hoodie support,
We are migrating from Hudi 12 to Hudi 15 in our production pipelins
but We are not able to migrate the pipelines and there is pipeline outage because pipelines are failing…