Open mayankanand007 opened 3 months ago
hey @mayankanand007 thanks for reporting this! I think this has to do with the fact that DuckDB uses a custom S3 implementation instead of an official SDK.
You could try switching to fsspec instead (https://duckdb.org/docs/guides/python/filesystems.html) but that may kindof defeat the purpose of your tests
Thanks a lot for all the work with
duckdb
! I have found it to be extremely useful!I'm running into an issue with querying files stored in a mock s3 bucket (working with the real s3 bucket), here are the details:
Error:
Steps to reproduce:
duckdb version: 1.0.0 s3fs: 2023.6.0 aiohttp: 3.9.0 aibotocore: 2.5.2 moto: 4.1.0
I'm using moto for mocking the s3 bucket. Specifically, I use the fixture defined in this comment: https://github.com/aio-libs/aiobotocore/issues/755#issuecomment-1424945194
Any advice for this? Thanks in advance!