search

chrislusf / gleam

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
Apache License 2.0
3.47k stars 290 forks source link

Hive metastore support? #139

Open antonputra opened 6 years ago

antonputra commented 6 years ago
  1. Is there a way to connect to Hive metastore to enable Hive quires agains existing Hive tables such as SparkHiveContext does? https://spark.apache.org/docs/latest/api/java/org/apache/spark/sql/hive/HiveContext.html
  2. Is it possible not only to read but also to write to Hive metastore like execute "CREATE TABLE" or "ALTER TABLE" statements?
chrislusf commented 6 years ago

I would like to know any existing Golang API to connect to Hive.

TimKack commented 6 years ago

@chrislusf - can https://github.com/derekgr/hivething be used?

chrislusf commented 6 years ago

This hive lib can query, but in a streaming way. Ideally something can do concurrent queries.

antonputra commented 6 years ago

Ideally, it would be great to have a hive metarepo to control datasets in relational way, but have kind of an OLAP engine(similar to Apache Druid) as for example cockroachdb exposes a Postgres API for OLTP.