-
See https://filscan.io/en/message/bafy2bzacebf2zuwngr7xj7kalkydegswappnpgtx633l7ngask56grflxmv2u/
-
Hello Hoodie support,
We are migrating from Hudi 12 to Hudi 15 in our production pipelins
but We are not able to migrate the pipelines and there is pipeline outage because pipelines are failing…
-
### Terraform Core Version
1.9.8
### AWS Provider Version
5.69.0
### Affected Resource(s)
While working with EMR, I followed the Terraform guide but encountered an error:
Incorrect attribute val…
-
**Describe the problem you faced**
Intermittent java.util.NoSuchElementException when writing to partitions that are out of order and not covered by the active timeline.
**To Reproduce**
W…
-
spark connector 개선
- service_config 추가
- spark jars 설정
- spark config
- local용으로 작게 잡아야하는 상황
- gcs용 설정과 asw용 설정 분리해야됨
- spark.haddop.fs.gs.impl와 spark 컴퓨팅 관련 설정들
- 현재…
-
**Describe the bug**
跑求交的时候发现三个spark-worker容器没有均分任务，一共三个线程，有一个容器占了两，另一个一个线程，还有个是空的，三个容器内存使用量区别很大
**To Reproduce**
Steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll d…
-
### Describe the enhancement requested
We should decide what to do with it. At the moment it is a part of Spark CI.
```
Exception in thread "main" java.lang.RuntimeException: Your current spark v…
-
**Describe the problem you faced**
Running an ETL on a table "Aggregate X Details". When running this on a large dataset i.e ~30M rows of data we partition our dataset into 50 partitions using RDD.co…
-
**Is your feature request related to a problem? Please describe.**
Provides users with the ability to connect and set up `Spark SQL` as a data source, enabling integration with distributed data proce…
-
When I use the current version of the package with spark 3.5 I get the following error:
```
23/10/27 16:06:36 WARN TaskSetManager: Lost task 2.0 in stage 3.0 (TID 4) (192.168.178.63 executor 0): jav…