-
We would like to convert html to markdown from a large collection of html using spark and web pages that require an internal network environment and authentication.
Is there a way to accomplish this…
-
We're building spark application on AWS EMR service, and seeing error when running the application:
```
Exception in thread "main" scala.ScalaReflectionException: object org.apache.spark.sql.KotlinR…
-
Hi! I made some updates in my project from **Spark 3.4.1** to **Spark 3.5.0** and updated the scalapb dependency from **sparksql34-scalapb0_11** to **sparksql35-scalapb0_11**. After this upgrade, I fa…
-
[ Disclaimer - I am fairly new with Pulsar so I might not understand all the pulsar details but I have been using spark from a while now. ]
I am using Apache Spark consumer for consuming data from Pu…
-
### Discussed in https://github.com/NVIDIA/spark-rapids-examples/discussions/327
Originally posted by **janaccnt** November 4, 2023
I try several [Spark Deep Learning inference notebooks](htt…
-
# Steps to recreate
1. launch minecraft with [spark](https://modrinth.com/mod/spark), [ommc](https://modrinth.com/mod/oh-my-minecraft-client), and dependencies.
2. join any world
3. type `/sparkc`
…
-
### Description
I'm using DBeaver to connect to a Hadoop environment with Hive (port 10000) and Spark (port 10001). I'm encountering two issues:
Spark SQL LIMIT syntax error:
When connecting to…
-
Will Carbonata be integrated with Spark in the future? Can Spark version 3.1.2 be integrated with Carbonata
-
Hi all !
Not sure if it's a real issue but we integrated OpenLineage in our databricks cluster and a lot of users use notebook to read data (without writing any).
So a lot of job have the same na…
-
My team wants to use py-spark in Kubeflow pipeline nodes.
This py-spark pipeline node is communicating with a completely independent MinIO instance and runs ANSI SQL commands to it.
When we create…