search

naushadh / hive-metastore

Apache Hive Metastore as a Standalone server in Docker
Apache License 2.0
67 stars 26 forks source link

Question, re S3 #11

Open georgelza opened 3 months ago

georgelza commented 3 months ago

Hi guys,

Don't see contact details so trying this path,

I'm busy looking at Apache Paimon and one of the options are to have it do schema management via HIVE. with Paimon being backed by HDFS, I don't require S3...

Is there a way your stand alone HMS can be deployed with the s3 option disabled ?

G georgelza@gmail.com

naushadh commented 3 months ago

I can certainly create provision to run without S3; I imagine your instance of HMS still requires the Postgres DB?

georgelza commented 3 months ago

Hi there, thanks, Yes on the PostgresDB.

for the fun of it i'm actually busy spinning up a 2 node Hive environment with PostgreSQL https://github.com/georgelza/MongoCreator-GoProducer-avro.git See infrastructure/build-hive-openjdk8 purely as a teach myself, welcome to look and comment. some optimisation that i want to do in the Dockerfile, build order, and bringing in all configuration files/values via mounts vs direct copies atm. and mine is ARM64 specific as that is my working lab/environment. G