-
Hi,
I wanted to ask about the fsspec convention of using '::' to chain URL handling protocols (e.g. simplecache with s3fs). Using '::' means the resulting string is not a URI (e.g. 'simplecache::s3…
-
### Is your feature request related to a problem? Please describe.
I haven't yet found a good way to open large (exceeds RAM) remote (not on my local file system) GRIB files in xarray.
### Describe …
-
### Is your feature request related to a problem? Please describe.
The backends developed within this package seem useful also outside of earthkit. Who doesn't like to have easier access to data and …
-
Hey everyone, we are using `snowflake-ml-python` from within Apache Airflow. In the [constraints file](https://raw.githubusercontent.com/apache/airflow/constraints-2.8.4/constraints-3.10.txt) for the …
-
### Bug description
In `FSDPStrategy.save_checkpoint`, the `filepath` variable is transformed via
https://github.com/Lightning-AI/pytorch-lightning/blob/3627c5bfac704d44c0d055a2cdf6f3f9e3f9e8c1/src/…
-
AFAIK the only filesystems we need to read from are local and cloud, so could we just use pathlib and [cloudpathlib](https://github.com/drivendataorg/cloudpathlib)?
-
The following stackoverflow question brought to my attention that, although this repo has an fsspec-compatible class, it is not registered with fsspec, so calls like fsspec.open("gdrive://...") don't …
-
When files are very close to 1 GB (1,048,576 KB), only the first 1 GB of the file is uploaded when using `S3FileSystem` (I haven't tested with other file systems), whereas using `boto3` directly works…
-
### Describe the bug
I am trying to download the `librispeech_asr` `clean` dataset, which results in a `FSTimeoutError` exception after downloading around 61% of the data.
### Steps to reproduce the…
-
# Problem Description
When attempting to copy or move large objects (e.g., 5GB) using the cp or mv operations with s3fs (via fsspec), the operation silently fails or produces an error. This behavior …