search

apache / iceberg-go

Apache Iceberg - Go
https://iceberg.apache.org/
Apache License 2.0
143 stars 35 forks source link

GCS support? #60

Closed thorfour closed 7 months ago

thorfour commented 9 months ago

Was looking into this library and saw that GCS support was in the matrix but was unsupported yet.

Looking at the io package that abstracts the storage layer and I was wondering if this could be implemented by https://github.com/thanos-io/objstore/ ?

If so it already supports S3, GCS as well as local filesystem and much more.

zeroshade commented 9 months ago

That's definitely an interesting and valid idea. Would you be willing to sketch out a PR for it?

thorfour commented 9 months ago

Yea absolutely!

thorfour commented 9 months ago

@zeroshade I took a stab at what it might look like in #66 let me know what you think.