Open apostolos-geyer opened 2 weeks ago
Thanks @apostolos-geyer .... Good catch!
This definitely seems like a bug. Would LOVE to take a contribution ❤️
Here are some quick tips:
We probably will want to only do the detection of credentials (S3Config.from_env()
) only if the Delta path provided is an S3 path.
Feel free to shoot us any questions about contributing :)
Describe the bug A clear and concise description of what the bug is.
When attempting to read a local deltalake, daft will log multiple errors and attempt to retrieve S3 credentials, create a client for us-east-1, etc. Not sure if this is a bug or if there is some behaviour or configuration for daft to understand I'm working with local files and not to try to use S3, but I couldn't find anything about this in the docs. The file is still read successfully, but it would be nice to not have to wait for it to fail to get a session token, and attempt to create an S3 client.
To Reproduce Steps to reproduce the behavior:
output:
Expected behavior A clear and concise description of what you expected to happen.
The local deltalake should be read without attempting to use S3 or any other network locations and without logging errors.
Screenshots If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
If you guys are looking for contributors, I'd be happy to try and fix this myself. Never contributed to anything before so not sure if there's any procedures but if I can I'll give it a shot.