dremio / iceland

Apache License 2.0
1 stars 4 forks source link

Add docker for Spark+Iceberg+Nessie+MinIO #1

Closed ajantha-bhat closed 1 year ago

ajantha-bhat commented 1 year ago

Inspired from https://github.com/tabular-io/docker-spark-iceberg

snazy commented 1 year ago

What's the benefit over https://github.com/projectnessie/nessie-demos, which can be run by everyone via a browser without the need of doing the "docker compose dance"?

ajantha-bhat commented 1 year ago

What's the benefit over https://github.com/projectnessie/nessie-demos, which can be run by everyone via a browser without the need of doing the "docker compose dance"?

Nessie demo notebook I thought of adding to this repo also thinking it will be useful for user to understand the Nessie scenarios if they already have this docker running.

jbonofre commented 1 year ago

The main differences of this repo compared to nessie-demos are:

I think it makes sense to cross link and do everything related to Nessie in nessie-demos. The rest (hive/hdfs/jdbc based catalog) should be in iceland.

snazy commented 1 year ago

Looking forward to contributions to nessie-demos :)

ajantha-bhat commented 1 year ago

closing in the favour of Nessie demos