Add support for BigTable Online Storage

feast-dev / feast-java-old

Feast Java Components

Apache License 2.0

12 stars 29 forks source link

Add support for BigTable Online Storage #17

Closed terryyylim closed 3 years ago

terryyylim commented 3 years ago

Signed-off-by: Terence Lim terencelimxp@gmail.com

What this PR does / why we need it:

Support BigTable store for Online Serving as alternative to Redis and Redis Cluster (See issue in feast-spark repository for more details)
Related Spark ingestion PR: https://github.com/feast-dev/feast-spark/pull/46

Which issue(s) this PR fixes:

Fixes #

Does this PR introduce a user-facing change?:

BigTable online store is available as alternative storage to Redis and Redis Cluster.

woop commented 3 years ago

By the way, can we please do a comparison of the size of the serving jar before and after adding Bigtable? I remember some folks had reasonable concerns about bloat in both Core and Serving previously when we pulled in all the GCP dependencies.

terryyylim commented 3 years ago

By the way, can we please do a comparison of the size of the serving jar before and after adding Bigtable? I remember some folks had reasonable concerns about bloat in both Core and Serving previously when we pulled in all the GCP dependencies.

Before adding Bigtable: 89652017 bytes After adding Bigtable: 99218087 bytes