-
Hi, I got an exception when the data was saved to clickhouse by sparkSQL with clickhouse-jdbc.
This would happen, when the type of the columns was Array[Int64].
And the SparkSql will handle the ar…
-
We tried to run TPC-DS with gazelle plugin and found q64.sql would fail because the value of "spark.oap.sql.columnar.preferColumnar" changes from "true" to "false". We use this tpcds-kit(https://githu…
-
`promises` is very useful in time-consuming operation, such as spark data collecting.
In my daily job, I am heavy using Spark and Rmarkdown. If Rmarkdown SQL chunks could support execute Spark SQL …
-
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at dev-subscribe@h…
-
Getting the following error while running HBaseSparkInsert :
Exception in thread "main" java.lang.ClassNotFoundException: Failed to find data source: org.apache.spark.sql.execution.datasources.hbas…
-
Hi,
I follow the doc but it does not work:
```
com.springml
spark-sftp_2.11
1.1.1
```
```
spark.read().
format("com.sprin…
-
# Hadoop 의 YARN 과 Eco System
## YARN
- Yet Another Resource Negotiator
- **빅데이터의 지휘자** 와 같은 역할
- 리소스를 분석해서 적절한 Job 에게 적절하게 할당함
- 하둡 클러스터에 데이터 처리를 동시에 담당
- Demon 을 통해 자원 관리 역할을 수행
- 태초의 리소스 매…
snaag updated
2 weeks ago
-
I found we don't have a native spark-clickhouse-source, but I need read some data from Clickhouse table,so I use spark-jdbc-source instead, and a problem came across. which will lead some of data can'…
-
As the title suggests, the integration is encountering a `StackOverflowError` that tears down a running Spark application. The issue arises when a circular reference is encountered during serialisatio…
-
**Describe the bug**
Recently I did some test on DataFusion's String related build-in functions. I found there are lots of gaps compared with Spark SQL's (3.x) result. Some of them maybe bug in Spar…