-
Hi @wajda
I have a spark code that I got from someone in the organization that has Scala Code
They have a Configuration.conf like this
If I add in the config file:
```yaml
spline {
li…
-
Hi guys,
I'm using kafka, spark streaming 1.62 and spark-redshift. it works well at first, and then suddenly get these error message below:
> ========= 2016-09-28 08:47:00 =========
> 16/09/28 08:47…
-
I am using Spark `ML_pipelines` to easily deploy operations that I have developed in `Sparklyr` in a production environment using `SCALA`. It is working pretty well, except for one part: it seems that…
-
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.(Path.java:135)
at org.apache…
-
### Description
### Backend
Velox
### Perf description
When switching from tpch 1T to tpch 3T, the Shuffle Read time of q21 will significantly increase, and the system's disk/network resources are…
-
total data : 60Million
use spark to read hive data, then save the data to Doris use **spark-doris-connector-2.3_2.11**, but when load about 20million, the spark job is dead with the log
```
2022-04…
-
spark version 2.4.5
atlas version 2.0.0
use maven execute
mvn package -DskipTests
successful!!
this screenshot
![image](https://user-images.githubusercontent.com/48819512/82986558-a07e7700-a02…
-
Name | Storage Model | Distribution Type | Row Count | Memory Size | Total Size
-- | -- | -- | -- | -- | --
APP.TEST | COLUMN | PARTITIONED | 4,017,002 | 16.0 MB | -12298615.0 B
APP.TEST2 | COLUM…
-
**Describe the problem you faced**
Using DynamoDB as the lock provider for concurrent writes results in an error stating java.lang.NoClassDefFoundError: com/amazonaws/services/dynamodbv2/model/Lock…
-
### Backend
CH (ClickHouse)
### Bug description
When run sql `select cast(clk as decimal)/cast(0 as decimal) as p from xxxxx`, it throw exception:
![image](https://github.com/oap-project/gluten/a…