Failing trino-minio setup

[iuliu-b]

After pulling the latest version I'm getting a failure different from https://github.com/bitsondatadev/trino-getting-started/issues/45 Edit: scratch that, see extended stack trace: it's the same error as before

hive-metastore_1     | Metastore connection URL:     jdbc:mysql://mariadb:3306/metastore_db
hive-metastore_1     | Metastore Connection Driver :     com.mysql.cj.jdbc.Driver
hive-metastore_1     | Metastore connection User:    admin
hive-metastore_1     | Starting metastore schema initialization to 3.0.0
hive-metastore_1     | Initialization script hive-schema-3.0.0.mysql.sql
hive-metastore_1     | 1/506        -- MySQL dump 10.13  Distrib 5.5.25, for osx10.6 (i386)
hive-metastore_1     | 2/506        --
hive-metastore_1     | 3/506        -- Host: localhost    Database: test
hive-metastore_1     | 4/506        -- ------------------------------------------------------
hive-metastore_1     | 5/506        -- Server version   5.5.25
hive-metastore_1     | 6/506        
hive-metastore_1     | 7/506        /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */;
hive-metastore_1     | Warning: Unknown column 'RESERVED' in 'where clause' (state=42S22,code=1054)
hive-metastore_1     | java.sql.SQLWarning: Unknown column 'RESERVED' in 'where clause'
hive-metastore_1     |  at com.mysql.cj.protocol.a.NativeProtocol.convertShowWarningsToSQLWarnings(NativeProtocol.java:2065)
hive-metastore_1     |  at com.mysql.cj.jdbc.StatementImpl.getWarnings(StatementImpl.java:1733)
hive-metastore_1     |  at sqlline.Commands.execute(Commands.java:828)
hive-metastore_1     |  at sqlline.Commands.sql(Commands.java:733)
hive-metastore_1     |  at sqlline.SqlLine.dispatch(SqlLine.java:795)
hive-metastore_1     |  at sqlline.SqlLine.runCommands(SqlLine.java:1706)
hive-metastore_1     |  at sqlline.Commands.run(Commands.java:1317)
hive-metastore_1     |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore_1     |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore_1     |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore_1     |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore_1     |  at sqlline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:38)
hive-metastore_1     |  at sqlline.SqlLine.dispatch(SqlLine.java:791)
hive-metastore_1     |  at sqlline.SqlLine.initArgs(SqlLine.java:595)
hive-metastore_1     |  at sqlline.SqlLine.begin(SqlLine.java:643)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1034)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1007)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:596)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:574)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.run(MetastoreSchemaTool.java:1273)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.main(MetastoreSchemaTool.java:1178)
hive-metastore_1     |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore_1     |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore_1     |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore_1     |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore_1     |  at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore_1     |  at org.apache.hadoop.util.RunJar.main(RunJar.java:236)

hive-metastore_1     | MetaException(message:Error creating transactional connection factory)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:84)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8541)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8536)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:8806)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:8723)
hive-metastore_1     |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore_1     |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore_1     |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore_1     |  at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore_1     |  at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore_1     |  at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
hive-metastore_1     | Caused by: MetaException(message:Error creating transactional connection factory)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:208)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
hive-metastore_1     |  at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:80)
hive-metastore_1     |  ... 11 more

[bitsondatadev]

Ah, okay I think this calls for a refactoring. At this point there are a few catalog options and I need to add REST to this catalog and I'll see if there are upstream issues going on or if there was a change in the configuration for HMS I need to figure out.

Thanks for continuing to report this! @tschaub also thanks for removing the other config that was breaking everything :) I need to reconsider how I manage these configs at some point. It would be nice to create a primary template that would allow for extra properties for each subproject.

[bitsondatadev]

I think a setup like this would be beneficial with a tutorial on catalogs.

[iuliu-b]

@bitsondatadev

I'll see if there are upstream issues going on or if there was a change in the configuration for HMS I need to figure out

Correct me if I'm wrong - seems like the HMS image is fixed at 3.0.0 (this project's compose file is targeting bitsondatadev/hive-metastore:latest, but bitsondatadev/hive-metastore itself has 3.0.0 hardcoded) - so HMS configuration couldn't have changed?

Asking because I'd love to have a working version of trino-minio to play around with, and am wondering if the answer is to walk back through the package versions of the latest depedencies (trinodb/trino:latest, mariadb:latest, minio/minio:latest) until I reach a working hardcoded version set)

[iuliu-b]

I think the root cause is this issue https://github.com/sysown/proxysql/issues/3017

and the project works fine using mariadb:10.6.16