-
We are trying to use the Hadoop config to assume a role when writing/reading to s3. The library is not assuming the role when reading/writing to s3.
-
Hi All,
I am doing stress testing of Presto queries on hudi tables on S3. When I run the query individually I am getting the result in **3 seconds**, but when I increase the concurrency(100 queries…
-
Sorry for not jumping to current version
Presto 0.194
Hive HCatalog 2.3.2
hive-site.xml:
```
fs.s3.awsAccessKeyId
secret
fs.s3.awsSecretAccessKey
secret
```
created an …
-
### Lambda
example
```
def lambda_handler(event, context):
return {
"statusCode": 200,
"headers": { "Content-Type": "application/json" },
"body": json.dumps({ ... …
-
#### Environement
EMR 6.7.0 Spark 3.2.1
Hudi 0.11.0
#### Job Info
Hudi table type: MOR
Storage: AWS S3
Spark Structured Streaming foreachBatch multiple task write different hudi tables。An erro…
yhyyz updated
4 months ago
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
Hi
delta lake provides ACID transformation to parquet files.
AWS provides a delta-lake connector for its commercial presto.
Starbust blogged recently that they are in this process.
Is there a…
-
## Test report for EMR related issue
### Check list
- [x] Step 1. [**OPTIONAL**]Understand background/root cause/design basically(one hour EST) . Its issue type is
- [x] bug fix
- [ ] n…
-
val x = sc.loadGenotypes("s3a://1000genomes/phase1/analysis_results/integrated_call_sets/ALL.chr17.integrated_phase1_v3.20101123.snps_indels_svs.genotypes.vcf.gz")
generates error Unable to execute…
-
so over the weekend s3 eventual consistency on list operations because really slow and it seems the s3 list index was retuning files that were actually deleted, therefore i was getting COPY errors.
S…