-
**Describe the feature you'd like to have.**
Hi again 👋🏼
Would it be possible to support Kopia? I know you already have support for restic, for data backups, but I figured Kopia would fit in …
-
@magland @rly we are working on the nwb-benchmarks and am encountering a strange issue https://github.com/NeurodataWithoutBorders/nwb_benchmarks/issues/57 Do you have an idea? It looks like this might…
-
I think a good "infrastructure" target for the NASA OSS call would be to expand our benchmarking suite (https://pandas.pydata.org/speed/xarray/#/)
AFAIK running these in a useful manner on CI is st…
-
Creating Hive partition strings is very common when writing to file-like storages (such as `aws_s3`). Unfortunately, creating these partition strings is fraught with foot-guns. To protect users from t…
-
I am trying to benchmark my datasets based implementation against fairseq's [`MMapIndexedDataset`](https://github.com/pytorch/fairseq/blob/master/fairseq/data/indexed_dataset.py#L365) and finding that…
-
### 🐛 Describe the bug
After `AWSSDK` is integrated with TorchData, we now have two categories of `DataPipe`s to access and load data from AWS S3 Bucket:
1. [`DataPipe`](https://github.com/pytorch/d…
-
(creating this issue on @enescakir's behalf)
**Summary**: We'd like to introduce caching for our GitHub Actions integration. We realize that there are 3 separate problems to solve, with some overla…
-
### Describe the bug
When trying to create an S3TransferManager using the S3TransferManager builder, I get a NoClassDefFoundError in a specific runtime.
### Expected Behavior
Create an S3Tr…
-
Rocksdb version 6.8.1 and 8.3.1
Performing bulkloads throughput benchmarking on 16 core and 32 core machines.
I am doing batchwrites (simialr observation with put)
for bulkload i turn off all…
-
We have developed S3ReaderFactory plugin - an HTSJDK CustomReaderFactory implementation. It enables comfortable and fast direct reading of the SAM/BAM files stored in AWS S3 storage (both private and …
ghost updated
8 years ago