-
Hi, how are you?
Im using EMR 5.30.1, spark 2.4.5, hudi 0.5.2 and my data is store in S3.
Since today Im trying to migrate some of our datasets in production to apache hudi, Im having problems w…
-
Hi Guys,
I have a small dataset 7 gb, because of that, I didn't partition the data, I prefer create some big files, so Hudi created 13 files of 700mb each. My dataset has a auto increment id, its a…
-
Log Type: stderr
Log Upload Time: Tue Mar 20 17:24:32 +0800 2018
Log Length: 596
Note: /tmp/sqoop-yarn/compile/c4…
sdgmf updated
3 years ago
-
**Environment:**
1. Framework: (TensorFlow, Keras, PyTorch, MXNet) Keras
2. Framework version: 2.2.4
3. Horovod version:
4. MPI version:
5. CUDA version:9.2
6. NCCL version:2.2.12
7. Python ver…
-
When trying to sync SH database `SoftwareHeritageOriginsImporter` surprisingly failed with:
```
aused by: java.lang.NoSuchFieldError: INSTANCE
at org.apache.http.conn.ssl.SSLConnectionSocketFact…
-
DVC version: 0.86.5
# Error
Suddenly happened from one day to another. Worked the other day.
```
DVC version:
# Error
```bash
(project) [username@hostname:~/project/assets/models]dvc…
-
*For better global communication, please give priority to using English description, thx! *
**Describe the question**
A clear and concise description of what the question is.
The shell task execu…
-
Trying to submit a simple job to read and write data from cloud storage. I am able to read the data, but for some reason cannot write the data.
my spark context:
```
./bin/pyspark --master k8s…
-
I am trying to write data into existing Hoodie COW format and also trying to sync hive table along with it as spark data set.
I have 2 datasets which i need UPSERT based on the ids that are present i…
-
I am currently trying to integrate DataLake as a file storage with Node.js app. So far, if I omit typings issue which is already reported here, I have some problems with reading files.
I am using c…