StarRocks / starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
https://starrocks.io
Apache License 2.0
8.89k stars 1.78k forks source link

Support nessie catalog #39842

Open colagy opened 9 months ago

colagy commented 9 months ago

Enhancement

https://projectnessie.org/

image

16bzwiener commented 8 months ago

+1

chulucninh09 commented 7 months ago

+1

margorczynski commented 6 months ago

+1

chrisfw commented 5 months ago

+1

mrhamburg commented 5 months ago

Nessie will have an integrated iceberg catalog, perhaps this will already support this use case:

https://projectnessie.org/blog/2024/05/13/nessie-integration-of-iceberg-rest/

chrisfw commented 5 months ago

Thanks for the info, @mrhamburg , you are correct, I received confirmation that Nessie support for the iceberg rest spec should be released in a few weeks which is great news!

Valkyrie298 commented 3 months ago

I tried to integrate Nessie with Starrocks. but the databases don't show on Starrocks. But they do exists on Nessie

CREATE EXTERNAL CATALOG iceberg_nessie PROPERTIES ( "type" = "iceberg", "iceberg.catalog.type" = "rest", "iceberg.catalog.uri"="http://xxx.xxx.xxx.xxx:19121/iceberg/", "iceberg.catalog.warehouse"="warehouse", "aws.s3.enable_ssl" = "false", "aws.s3.enable_path_style_access" = "true", "aws.s3.endpoint" = "http://xxx.xxx.xxx.xxx:9000", "aws.s3.access_key" = "minioadmin", "aws.s3.secret_key" = "minioadmin" "client.factory"="com.starrocks.connector.iceberg.IcebergAwsClientFactory" );

StarRocks > set catalog iceberg_nessie; Query OK, 0 rows affected (0.00 sec)

StarRocks > create database uw2; Query OK, 0 rows affected (0.09 sec)

StarRocks > show databases; Empty set (0.03 sec)

the uw2 database does exists on Nessie. Perhaps there's something that I did wrong?

MaheshSankaran commented 1 month ago

+1

dorsegal commented 3 weeks ago

+1

akizminet commented 2 days ago

+1