[Merged by Bors] - Create Hive/HDFS and Hive/S3 Trino stack for Hive migration testing

stackabletech / stackablectl

Commandline tool to interact with a Stackable Data Platform

Other

8 stars 1 forks source link

[Merged by Bors] - Create Hive/HDFS and Hive/S3 Trino stack for Hive migration testing #173

Closed Jimvin closed 1 year ago

Jimvin commented 1 year ago

Description

Create a stack that deploys 2 Hive metastores with HDFS and S3 plus Trino for testing legacy Hive migration.

Review Checklist

[x] Code contains useful comments
[x] (Integration-)Test cases added (or not applicable)
[x] Documentation added (or not applicable)
[x] Changelog updated (or not applicable)
[x] Cargo.toml only contains references to git tags (not specific commits or branches)

Once the review is done, comment bors r+ (or bors merge) to merge. Further information

sbernauer commented 1 year ago

~As of now this only contains a stack. Do you plan to add a demo before merging? I personally am not sure if only the stack itself is worth "advertising" it to users already. I would love to have some sort of storay to tell and follow along~

Answered on Slack

This might be sufficient documentation. I’m not certain I’ll have a stackablectl demo to go along with this, so I’ve not added it to the docs. It’s more of a playground stack for Trino testing.

Jimvin commented 1 year ago

bors +r

bors[bot] commented 1 year ago

Did you mean "r+"?

Jimvin commented 1 year ago

bors r+

bors[bot] commented 1 year ago

Pull request successfully merged into main.

Build succeeded:

Run Rustfmt

sbernauer commented 1 year ago

create schema hivehdfs.hdfs with (location='hdfs://hdfs/trino') and create table hivehdfs.hdfs.foo as select 42 as foo worked fine. Having this stack as-is is ok for me (e.g. for blogs), but I'm looking forward to a demo :)