search

apache / iceberg-rust

Apache Iceberg
https://rust.iceberg.apache.org/
Apache License 2.0
642 stars 150 forks source link

Tracking issues of storage backend integration tests #410

Open Xuanwo opened 4 months ago

Xuanwo commented 4 months ago

I agree that we can label these features as experimental. Setting up the CI infrastructure requires time, more so than implementing those features.

Originally posted by @Xuanwo in https://github.com/apache/iceberg-rust/issues/408#issuecomment-2178730480

jdockerty commented 3 months ago

@Xuanwo I can take a shot at GCP GCS if nobody else is working on that at the moment 👍

liurenjie1024 commented 3 months ago

@Xuanwo I can take a shot at GCP GCS if nobody else is working on that at the moment 👍

Hi, @jdockerty thanks for you interest. How do you plan to do it? Is there any open source containers that could mock gcs?

jdockerty commented 3 months ago

How do you plan to do it? Is there any open source containers that could mock gcs?

@liurenjie1024

There is this mock which I found earlier: https://github.com/fsouza/fake-gcs-server

Failing this, my plan was to use an actual GCS bucket for testing the functionality - given this was mentioned at being potentially experimental for now. Granted, this isn't ideal for CI, but the mock from above looks relatively well-used at first glance 👍

liurenjie1024 commented 3 months ago

How do you plan to do it? Is there any open source containers that could mock gcs?

@liurenjie1024

There is this mock which I found earlier: https://github.com/fsouza/fake-gcs-server

Failing this, my plan was to use an actual GCS bucket for testing the functionality - given this was mentioned at being potentially experimental for now. Granted, this isn't ideal for CI, but the mock from above looks relatively well-used at first glance 👍

Thanks @jdockerty , using this mock is fine to me.