search

Eventual-Inc / Daft

Distributed DataFrame for Python designed for the cloud, powered by Rust
https://getdaft.io
Apache License 2.0
1.82k stars 113 forks source link

Getting hyper error connecting to s3 #1747

Open dioptre opened 6 months ago

dioptre commented 6 months ago

We are getting this random error (more than) occasionally:

[aws_smithy_client.hyper_ext,None:221] [WARNING] unrecognized error from Hyper. If this error should be retried, please file an issue. err=error trying to connect: bad certificate format: bad certificate format (hyper::Error(Connect, Error { code: -9808, message: "bad certificate format" }))

While pulling from "s3://"

Weird as we are using verify_ssl=False, check_hostname_ssl=False,

samster25 commented 6 months ago

Hi @dioptre,

Thanks for making an issue! Have a few questions:

  1. Does this error error out the read or is it just logging the message out and retrying?
  2. Also what S3 endpoint are you using, AWS or some private endpoint?
  3. What OS is this happening on?
dioptre commented 6 months ago
  1. errors out
  2. s3
  3. Mac/Darwin

thx!

samster25 commented 5 months ago

@dioptre Are you using an M1 Mac? Is so can you reply with the output of the following commands (where python is the shell you used):

file $(which python3)

as well as python -m sysconfig

jaychia commented 2 months ago

Hi @dioptre ! Wondering if this issue can be closed/are you still seeing this in production?