-
Hi
I asked this [question](https://groups.google.com/forum/#!topic/flambo-user/qKcgkKbM4oE) over on the Flambo google group a few days ago however I'm not sure how active it is. Sorry if I'm just b…
-
### Description
As Gluten currently can't fully cover spark functions, we will have to fallback some operators to Vanilla Spark, which leads an conflict of offheap and onheap memory conflict. Current…
-
-
**Describe the problem you faced**
with the HoodieROTablePathFilter load normal parquet file, it will be too slow when reaches a certain order of magnitude
For example：500 partitions and 500…
-
### 공식문서
* https://spark.apache.org/docs/2.4.0/api/sql/index.html#substr
### substring
* substring(str, pos[, len]) : 부분 문자열을 리턴한다. `pos`에서 시작해서 `len` 만큼의 길이의 부분 문자열을 리턴한다. 주의할 점은 `pos`가 1부터 시작…
-
I was looking at different options to connect to HBase from Spark, and I came across 2 solutions that look rather similar. One of them is this project, and the other is the hbase-spark connector that …
-
spark： 3.2.4
hadoop：3.2.4
hudi：0.13.1
create table hudi_cow_nonpcf_tbl (
uuid int,
name string,
price double
) using hudi
tblproperties (
primaryKey = 'uuid'
);
insert into hu…
-
我在使用Spark-Connector读取Starrocks数据时，遇到数据类型转换的问题。
我目前使用的版本信息
Starrocks: 2.5.1
Spark: 3.2.0
Starrocks-Spark-Connector: 1.1.0
背景如下：
表中有个字段 dt 类型是 date
使用SparkSQL DataFrame读取Starrock, 这张表的数据。报错…
-
This is related to #84 and is a super set of it.
Spark is a bit of a hot mess with support for floating point `-0.0`
Most SQL implementations normalize `-0.0` to `0.0`. Spark does this for the …
-
Per my comment on #755 DBR 14.2, 4.0 and likely all later versions includes [SPARK-44913 StaticInvoke changes](https://github.com/apache/spark/pull/42612).
Whilst this hasn't yet been backported to…