-
We already do this for Java: https://github.com/apache/beam/blob/master/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/UploadIdResponseIntercepto…
-
Is there a way to use this tool using GCS Service Accounts? We no longer use access keys in our projects but can't seem to get an upload to a bucket without providing S3 access key/tokens.
If you c…
-
I'm reading through the code to try and calculate how many remote store calls one would expect from a normal Kafka deployment.
As far as I trace the read path, I notice that for each chunk we cal…
-
OpenDAL supports conditional requests at the API level, although not all supported services have implemented them. This issue is used to track their implementation.
## Steps
Implement `if_none_m…
-
**Usecase:**
I am trying to save a raster object as a .tif file in gcs, with these lines of code:
f
-
## Overview
Using the com.google.cloud:spring-cloud-gcp-storage:5.0.4 library the storage.create() function has now been listed as deprecated to upload files to GCS bucket.
They now have a createF…
-
How to pass a custom jsonL for finetuning job like by just uploading the jsonl file to GCS or upload the Jsonl file on huggingface and also in the args how to pass evaluation args
-
### Is your feature request related to a problem? Please describe
Coming from conversation on https://github.com/opensearch-project/OpenSearch/pull/16072
The [repository-gcs plugin](https://gith…
-
If someone tries to upload a very large file, say 400MB, then the uploader will fail during proto serialization. This is because the file will exceed the maximum array length in Javascript which is 2^…
-
Summary: GCS Read/Write could use resumable uploads and downloads to recover better from network failures or other transient issues
I've noticed that the Google Cloud Storage support for htslib mak…