search

duckdb / duckdb_delta

DuckDB extension for Delta Lake
MIT License
140 stars 15 forks source link

eltaKernel FFI error: Not authorized to perform sts:AssumeRoleWithWebIdentity #112

Open alberttwong opened 3 weeks ago

alberttwong commented 3 weeks ago 
select * from DELTA_SCAN('s3a://oh-project-ajax/sales/sales/datahubtest/v3') limit 10;
IO Error: Hit DeltaKernel FFI error (from: While trying to read from delta table: 's3a://oh-project-ajax/sales/sales/datahubtest/v3/'): Hit error: 8 (ObjectStoreError) with message (Error interacting with object store: Generic S3 error: Client error with status 403 Forbidden: <ErrorResponse xmlns="https://sts.amazonaws.com/doc/2011-06-15/">
  <Error>
    <Type>Sender</Type>
    <Code>AccessDenied</Code>
    <Message>Not authorized to perform sts:AssumeRoleWithWebIdentity</Message>
  </Error>
  <RequestId>dd2d7c47-b8d0-46f5-8282-93a1a6d25156</RequestId>
</ErrorResponse>
)
alberttwong commented 3 weeks ago

however I don't get this issue when I do a ICEBERG_SCAN().

samansmink commented 1 week ago

Thanks for reporting @alberttwong, How are you authenticating the request? Is the bucket private or public?

alberttwong commented 1 week ago

i only have an s3 default secret. bucket is private.