Closed afermg closed 8 months ago
While working through boto3, polars-based access to open AWS files. I went through this issue and also tried specifying the filesystem:
mport pyarrow as pa from s3fs import S3FileSystem pl.read_parquet(file_path, pyarrow_options={"filesystem" : S3FileSystem(anonymous=True)})
to no success. There's probably a way, it is worth looking into the pyarrow documentation.
While working through boto3, polars-based access to open AWS files. I went through this issue and also tried specifying the filesystem:
to no success. There's probably a way, it is worth looking into the pyarrow documentation.