apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://gravitino.apache.org
Apache License 2.0
1.1k stars 348 forks source link

[Bug report] In the Gravitino Web UI Adding a property of the same name updates the value #1419

Closed justinmclean closed 10 months ago

justinmclean commented 10 months ago

Describe what's wrong

In the Gravitino Web UI Adding a property of the same name updates the value.

image image

Error message and/or stacktrace

No error occurs. The user would be warned that the property already exists.

How to reproduce

The latest version in the main branch.

Additional context

No response

abant07 commented 10 months ago

Hey!

I'm a bit new to open source, but I was wondering if I could try this. Anything in particular that I need to know to reproduce the error besides following the ReadMe

justinmclean commented 10 months ago

First, you need to be able to start up Gravitino and the Gravitino Web UI Please take a look at: https://github.com/datastrato/gravitino/blob/main/docs/how-to-build.md https://github.com/datastrato/gravitino/blob/main/docs/webui.md

Alternatively, you can use the playground and the Gravitino Web UI. https://github.com/datastrato/gravitino/blob/main/docs/how-to-use-the-playground.md

Once you have that running, the error should be easy to reproduce.

justinmclean commented 10 months ago

If you run into any trouble or have any questions, I'd be happy to help you out.

abant07 commented 10 months ago

Sounds good!

abant07 commented 10 months ago

Hey I just had a quick question, so Im on Mac M2, and when I install docker, how would I configure it with the Gravitino. I'm new to Docker, so Im not very familiar how that works.

abant07 commented 10 months ago

Actually, I think I may have it working, but Ill see if I run into any errors. Also just to clarify on your previous message, you said I can alternativly use the Gravitino Web UI playground, but lets say I was able to get it working from the first two links, then I dont need the playground right?

Also, in the readme it mentions that if I am running on Mac, I can alternately use OrbStack, but docker is fine right? Because when I ran the ./gradlew build command, its giving me a message saying

"Tip: Please make sure to use OrbStack or execute the dev/docker/tools/mac-docker-connector.sh script before running the integration test on macOS."

Thanks! Amogh

abant07 commented 10 months ago

Ok I followed the steps for the installation to start up Gravatino, but I am running into some errors in the code with imporating libraries. Do you know why this is happening? Am I forgetting something?

For example, it says:

import com.datastrato.gravitino.client.GravitinoClient; The import com.datastrato.gravitino.client cannot be resolvedJava(268435846) com.datastrato.gravitino

public static GravitinoClient gravitinoClient; GravitinoClient cannot be resolved to a typeJava(16777218)

Theres a lot more errors (around 800), so I was concerned

justinmclean commented 10 months ago

OrbStack is optional and not required, you can use Docker Desktop. I'll need a bit more information. Can you list the steps you took to try and get it running?

abant07 commented 10 months ago
Screenshot 2024-01-14 at 12 03 39 PM

Sure

  1. I realized that the JDK I had installed before was JDK 21, and I needed JDK 17. So I uninstalled JDK 21 and then installed JDK 17

  2. I installed Docker Desktop, and I followed the instructions on this page https://github.com/wenjunxiao/mac-docker-connector. to set up docker. However, I didn't know if I needed to follow the configuration part where it stated the addr, port, etc. I also installed the gradle extension in VSCode

  3. Then, I forked the repo and cloned that. Open it in VS Code. It showed like 1000 errors in the java code. Especially like the libraries you were trying to import.

  4. I followed the quickstart and changed the jdk version to 17 in the gradle.properties file, then executed cd gravitino ./gradlew build -xtest

  5. then this ./gradlew compileDistribution

  6. then ./gradlew assembleDistribution

  7. lastly I executed this ./gradlew assembleTrinoConnector

The only errors I am getting are in the trino-connector directory. The libraries are not importing showing some libraries are not resolved.

The only thing I can think I did wrong was either I missed a execution command to set up trino, or I didn't set up Docker correctly.

Also just as an extra question, once I get this setup, to setup the UI part, how do I run that.

justinmclean commented 10 months ago

To help resolve your issue can you paste the output of ./gradlew build -x test here.

abant07 commented 10 months ago

Sure

Downloading https://raw.githubusercontent.com/gradle/gradle/v8.2.0/gradle/wrapper/gradle-wrapper.jar % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 63375 100 63375 0 0 218k 0 --:--:-- --:--:-- --:--:-- 218k

Configure project :web Kotlin DSL property assignment is an incubating feature.

Task :web:yarnSetup

added 1 package in 550ms

Task :docs:npmSetup

added 1 package in 1s

28 packages are looking for funding run npm fund for details

Task :web:yarnInstall yarn install v1.22.19 [1/5] Validating package.json... [2/5] Resolving packages... [3/5] Fetching packages... [4/5] Linking dependencies... warning " > @mui/x-data-grid@6.18.3" has unmet peer dependency "@mui/system@^5.4.1". warning " > @mui/x-tree-view@6.17.0" has unmet peer dependency "@mui/system@^5.8.0". warning "react-hot-toast > goober@2.1.13" has unmet peer dependency "csstype@^3.0.10".

Task :docs:lintOpenAPI No configurations were provided -- using built in recommended configuration by default.

validating /Users/amoghbantwal/Documents/GitHub/gravitino/docs/open-api/openapi.yaml... /Users/amoghbantwal/Documents/GitHub/gravitino/docs/open-api/openapi.yaml: validated in 118ms

Woohoo! Your API description is valid. 🎉

Task :web:yarnInstall [5/5] Building fresh packages... Done in 5.62s.

Task :web:lintCheck yarn run v1.22.19 $ next lint ✔ No ESLint warnings or errors Done in 1.83s.

Task :web:prettierCheck yarn run v1.22.19 $ prettier --check . Checking formatting... All matched files use Prettier code style! Done in 1.00s.

Task :web:webpack yarn run v1.22.19 $ env-cmd -f .env.static yarn build $ yarn format && next build $ prettier --write . .eslintrc.js 25ms (unchanged) .prettierrc.js 3ms (unchanged) .vscode/extensions.json 1ms (unchanged) .vscode/settings.json 1ms (unchanged) app/(home)/CreateMetalakeDialog.js 23ms (unchanged) app/(home)/DetailsDrawer.js 9ms (unchanged) app/(home)/MetalakeList.js 9ms (unchanged) app/(home)/MetalakesView.js 1ms (unchanged) app/(home)/page.js 1ms (unchanged) app/(home)/TableHeader.js 1ms (unchanged) app/layout.js 2ms (unchanged) app/login/page.js 5ms (unchanged) app/metalakes/CreateCatalogDialog.js 17ms (unchanged) app/metalakes/DetailsView.js 5ms (unchanged) app/metalakes/LeftContent.js 1ms (unchanged) app/metalakes/MetalakePath.js 3ms (unchanged) app/metalakes/MetalakeTree.js 9ms (unchanged) app/metalakes/MetalakeView.js 3ms (unchanged) app/metalakes/page.js 3ms (unchanged) app/metalakes/RightContent.js 3ms (unchanged) app/metalakes/TableView.js 3ms (unchanged) app/metalakes/TabsContent.js 2ms (unchanged) app/metalakes/template.js 0ms (unchanged) app/template.js 0ms (unchanged) components/ConfirmDeleteDialog.js 2ms (unchanged) components/Icon.js 1ms (unchanged) lib/api/auth/index.js 1ms (unchanged) lib/api/catalogs/index.js 1ms (unchanged) lib/api/metalakes/index.js 1ms (unchanged) lib/api/schemas/index.js 1ms (unchanged) lib/api/tables/index.js 1ms (unchanged) lib/api/version/index.js 0ms (unchanged) lib/enums/httpEnum.ts 68ms (unchanged) lib/hooks/useHasMounted.js 1ms (unchanged) lib/hooks/useStore.js 1ms (unchanged) lib/layout/AppBar.js 2ms (unchanged) lib/layout/Footer.js 2ms (unchanged) lib/layout/Layout.js 1ms (unchanged) lib/layout/Loading.js 1ms (unchanged) lib/layout/Logout.js 1ms (unchanged) lib/layout/MainContent.js 1ms (unchanged) lib/layout/navigation-events.js 0ms (unchanged) lib/layout/ScrollToTop.js 1ms (unchanged) lib/layout/VersionView.js 1ms (unchanged) lib/provider/client.js 1ms (unchanged) lib/provider/emotion.js 2ms (unchanged) lib/provider/index.js 0ms (unchanged) lib/provider/session.js 3ms (unchanged) lib/provider/store.js 0ms (unchanged) lib/provider/theme.js 1ms (unchanged) lib/settings/index.js 0ms (unchanged) lib/store/auth/index.js 5ms (unchanged) lib/store/index.js 1ms (unchanged) lib/store/metalakes/index.js 20ms (unchanged) lib/store/sys/index.js 2ms (unchanged) lib/styles/globals.css 11ms (unchanged) lib/theme/colors.js 1ms (unchanged) lib/theme/mui.js 20ms (unchanged) lib/theme/screens.js 1ms (unchanged) lib/theme/tailwind.js 1ms (unchanged) lib/utils/axios/Axios.ts 27ms (unchanged) lib/utils/axios/axiosCancel.ts 4ms (unchanged) lib/utils/axios/axiosRetry.ts 2ms (unchanged) lib/utils/axios/axiosTransform.ts 3ms (unchanged) lib/utils/axios/checkStatus.ts 4ms (unchanged) lib/utils/axios/helper.ts 4ms (unchanged) lib/utils/axios/index.ts 13ms (unchanged) lib/utils/color.js 1ms (unchanged) lib/utils/date.js 0ms (unchanged) lib/utils/index.js 4ms (unchanged) lib/utils/initial.js 2ms (unchanged) lib/utils/is.ts 2ms (unchanged) licenses/find-root.md 15ms (unchanged) licenses/glob-to-regexp.md 5ms (unchanged) licenses/hoist-non-react-statics.md 5ms (unchanged) licenses/json-parse-even-better-errors.md 4ms (unchanged) licenses/next.md 4ms (unchanged) licenses/nprogress.md 3ms (unchanged) licenses/react-redux.md 3ms (unchanged) licenses/redux-thunk.md 4ms (unchanged) licenses/redux.md 4ms (unchanged) licenses/styled-jsx.md 3ms (unchanged) licenses/throttle-debounce.md 6ms (unchanged) next.config.js 1ms (unchanged) package.json 1ms (unchanged) postcss.config.js 0ms (unchanged) README.md 12ms (unchanged) tailwind.config.js 0ms (unchanged) types/axios.d.ts 2ms (unchanged) types/global.d.ts 0ms (unchanged) ▲ Next.js 14.0.3

  • Environments: .env

Creating an optimized production build ... ✓ Compiled successfully Linting and checking validity of types ... Collecting page data ... Generating static pages (0/7) ... Generating static pages (1/7) Generating static pages (3/7) Generating static pages (5/7) ✓ Generating static pages (7/7) Finalizing page optimization ... Collecting build traces ...

Route (app) Size First Load JS ┌ ○ / 3.93 kB 380 kB ├ ○ /_not-found 880 B 85.1 kB ├ ○ /login 1.6 kB 245 kB └ ○ /metalakes 14.6 kB 397 kB

○ (Static) prerendered as static content

Done in 18.19s.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.2/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD SUCCESSFUL in 34s 143 actionable tasks: 23 executed, 43 from cache, 77 up-to-date

justinmclean commented 10 months ago

So the build from the command line works and you should be fine with that. I was able to reproduce your IDE issue and have raised an issue for it #1479.

abant07 commented 10 months ago

Ok, so what should I do in the meantime?

justinmclean commented 10 months ago

You can ignore the errors in the IDE and build via the command line. You don't need to work on the trino connector for this issue.

abant07 commented 10 months ago

Oh ok, I thoguht I would need to get that working before I can start up the web server for the UI part. Or is that completely seperate?

justinmclean commented 10 months ago

It's separate, and you will most likely be using the pre-built Gravitino playground when testing the UI, so there is no need for that to work in your IDE.

abant07 commented 10 months ago

Should I just follow the steps in these link?

https://github.com/datastrato/gravitino/blob/main/docs/webui.md

https://github.com/datastrato/gravitino/blob/main/docs/how-to-use-the-playground.md

justinmclean commented 10 months ago

Yes, that should get you started. You will not need to do anything to configure the UI; but make sure you start up the playground first before starting the Gravtino UI. If you use the playground, you do not need to start the gravitino service.

abant07 commented 10 months ago

I see, so after I start the playground with

git clone git@github.com:datastrato/gravitino-playground.git cd gravitino-playground ./launch-playground.sh

I can then open and see the web app on localhost 8080?

and then I can change the playground code to display different screens. ex: gravitino.authenticator = simple

I will also let you know if I run into any problems. Its a bit late over here, I will get started working on it tomorrow.

justinmclean commented 10 months ago

The playground will start the gravitino server and other needed services. The Gravitino Web UI can be started via the commands below and will be found on http://localhost:3000. There is no need to change gravitino.authenticator or any other configuration value.

cd gravitino
./gradlew build -x test
cd web
yarn server
abant07 commented 10 months ago

im getting an error trying to launch playground

gravitino-playground % ./launch-playground.sh [+] Running 119/5 ✔ gravitino 9 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 105.0s ✔ trino 17 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 164.8s ✔ mysql 11 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 77.9s ✔ hive 63 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 99.3s ✔ postgresql 14 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 15.6s [+] Running 6/6 ✔ Network gravitino-playground_default Created 0.2s ✔ Container playground-mysql Created 3.6s ✔ Container playground-postgresql Created 3.6s ✔ Container playground-hive Created 3.6s ✔ Container playground-gravitino Created 0.4s ✔ Container playground-trino Created 0.7s Attaching to playground-gravitino, playground-hive, playground-mysql, playground-postgresql, playground-trino Gracefully stopping... (press Ctrl+C again to force) Error response from daemon: Ports are not available: exposing port TCP 0.0.0.0:3306 -> 0.0.0.0:0: listen tcp 0.0.0.0:3306: bind: address already in use [+] Running 6/6 ✔ Container playground-trino Removed 0.0s ✔ Container playground-postgresql Removed 10.4s ✔ Container playground-mysql Removed 0.0s ✔ Container playground-gravitino Removed 0.0s ✔ Container playground-hive Removed 10.3s ✔ Network gravitino-playground_default Removed

it says port 3306 not available, but I have nothing running on that port. Even on the docker desktop, I have nothing running on that port.

justinmclean commented 10 months ago

Do you have MySQL running locally? If so, you will need to stop it running.

justinmclean commented 10 months ago

Try running this in your terminal to see what is listening on that port:

sudo lsof -nP -i4TCP:3306 | grep LISTEN
justinmclean commented 10 months ago

You have MySQL running and will need to stop it before running the playground.

abant07 commented 10 months ago

Oh yup, msql is running on that port, I will kill it

abant07 commented 10 months ago

[+] Running 119/5 ✔ postgresql 14 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 20.1s ✔ gravitino 9 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 74.5s ✔ hive 63 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 230.1s ✔ mysql 11 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 15.5s ✔ trino 17 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 96.3s [+] Running 6/6 ✔ Network gravitino-playground_default Created 0.9s ✔ Container playground-mysql Created 1.3s ✔ Container playground-hive Created 1.3s ✔ Container playground-postgresql Created 1.3s ✔ Container playground-gravitino Created 0.2s ✔ Container playground-trino Created 0.2s Attaching to playground-gravitino, playground-hive, playground-mysql, playground-postgresql, playground-trino playground-hive | * Starting OpenBSD Secure Shell server sshd playground-mysql | 2024-01-16 00:49:52+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.35-1.el8 started. playground-hive | ...done. playground-hive | # localhost:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10 playground-hive | # localhost:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10 playground-hive | # localhost:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10 playground-hive | # 0.0.0.0:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10 playground-hive | # 0.0.0.0:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10 playground-hive | # 0.0.0.0:22 SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.10 playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-postgresql | The files belonging to this database system will be owned by user "postgres". playground-postgresql | This user must also own the server process. playground-postgresql | playground-postgresql | The database cluster will be initialized with locale "en_US.utf8". playground-postgresql | The default database encoding has accordingly been set to "UTF8". playground-postgresql | The default text search configuration will be set to "english". playground-postgresql | playground-postgresql | Data page checksums are disabled. playground-postgresql | playground-postgresql | fixing permissions on existing directory /var/lib/postgresql/data ... ok playground-postgresql | creating subdirectories ... ok playground-postgresql | selecting dynamic shared memory implementation ... posix playground-postgresql | selecting default max_connections ... 100 playground-postgresql | selecting default shared_buffers ... 128MB playground-postgresql | selecting default time zone ... Etc/UTC playground-postgresql | creating configuration files ... ok playground-hive | 24/01/16 00:49:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-mysql | 2024-01-16 00:49:56+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql' playground-mysql | 2024-01-16 00:49:56+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.35-1.el8 started. playground-hive | Starting namenodes on [0.0.0.0] playground-mysql | 2024-01-16 00:49:56+00:00 [Note] [Entrypoint]: Initializing database files playground-mysql | 2024-01-16T00:49:56.385795Z 0 [Warning] [MY-011068] [Server] The syntax '--skip-host-cache' is deprecated and will be removed in a future release. Please use SET GLOBAL host_cache_size=0 instead. playground-mysql | 2024-01-16T00:49:56.385848Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead. playground-mysql | 2024-01-16T00:49:56.385860Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.35) initializing of server in progress as process 80 playground-postgresql | running bootstrap script ... ok playground-mysql | 2024-01-16T00:49:56.432278Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. playground-postgresql | performing post-bootstrap initialization ... ok playground-postgresql | syncing data to disk ... ok playground-postgresql | playground-postgresql | playground-postgresql | Success. You can now start the database server using: playground-postgresql | playground-postgresql | pg_ctl -D /var/lib/postgresql/data -l logfile start playground-postgresql | playground-postgresql | initdb: warning: enabling "trust" authentication for local connections playground-postgresql | You can change this by editing pg_hba.conf or using the option -A, or playground-postgresql | --auth-local and --auth-host, the next time you run initdb. playground-postgresql | waiting for server to start....2024-01-16 00:49:58.658 UTC [48] LOG: starting PostgreSQL 13.13 (Debian 13.13-1.pgdg120+1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit playground-postgresql | 2024-01-16 00:49:58.664 UTC [48] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" playground-postgresql | 2024-01-16 00:49:58.677 UTC [49] LOG: database system was shut down at 2024-01-16 00:49:57 UTC playground-postgresql | 2024-01-16 00:49:58.710 UTC [48] LOG: database system is ready to accept connections playground-postgresql | done playground-postgresql | server started playground-mysql | 2024-01-16T00:49:59.503938Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended. playground-postgresql | playground-postgresql | /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/init.sql playground-postgresql | CREATE DATABASE playground-postgresql | You are now connected to database "db" as user "postgres". playground-postgresql | CREATE SCHEMA playground-postgresql | CREATE TABLE playground-postgresql | CREATE TABLE playground-postgresql | CREATE TABLE playground-postgresql | CREATE TABLE playground-postgresql | COMMENT playground-postgresql | CREATE TABLE playground-postgresql | COMMENT playground-postgresql | CREATE TABLE playground-postgresql | COMMENT playground-postgresql | CREATE TABLE playground-postgresql | COMMENT playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 12 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 12 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 8 playground-postgresql | INSERT 0 17 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 9 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 7 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 8 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 23 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 19 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 12 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-hive | 0.0.0.0: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-afc2c69be418.out playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 19 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 9 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 13 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 17 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 14 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 8 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 17 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 7 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 26 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 7 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 16 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | INSERT 0 11 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 21 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 19 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 7 playground-postgresql | INSERT 0 19 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 21 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 8 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 8 playground-postgresql | INSERT 0 7 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 5 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 10 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 2 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 19 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 7 playground-postgresql | INSERT 0 18 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 9 playground-postgresql | INSERT 0 3 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 4 playground-postgresql | INSERT 0 13 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 1 playground-postgresql | INSERT 0 6 playground-postgresql | playground-postgresql | playground-postgresql | waiting for server to shut down....2024-01-16 00:50:00.833 UTC [48] LOG: received fast shutdown request playground-postgresql | 2024-01-16 00:50:00.838 UTC [48] LOG: aborting any active transactions playground-postgresql | 2024-01-16 00:50:00.842 UTC [48] LOG: background worker "logical replication launcher" (PID 55) exited with exit code 1 playground-postgresql | 2024-01-16 00:50:00.852 UTC [50] LOG: shutting down playground-postgresql | 2024-01-16 00:50:01.055 UTC [48] LOG: database system is shut down playground-postgresql | done playground-postgresql | server stopped playground-postgresql | playground-postgresql | PostgreSQL init process complete; ready for start up. playground-postgresql | playground-postgresql | 2024-01-16 00:50:01.469 UTC [1] LOG: starting PostgreSQL 13.13 (Debian 13.13-1.pgdg120+1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit playground-postgresql | 2024-01-16 00:50:01.469 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 playground-postgresql | 2024-01-16 00:50:01.470 UTC [1] LOG: listening on IPv6 address "::", port 5432 playground-postgresql | 2024-01-16 00:50:01.474 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" playground-postgresql | 2024-01-16 00:50:01.484 UTC [64] LOG: database system was shut down at 2024-01-16 00:50:00 UTC playground-postgresql | 2024-01-16 00:50:01.530 UTC [1] LOG: database system is ready to accept connections playground-hive | localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-afc2c69be418.out playground-hive | localhost: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | localhost: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | localhost: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | 2024-01-16T00:50:06.457583Z 6 [Warning] [MY-010453] [Server] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option. playground-mysql | 2024-01-16T00:50:08.217512Z 6 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-hive | Starting secondary namenodes [0.0.0.0] playground-mysql | 2024-01-16 00:50:16+00:00 [Note] [Entrypoint]: Database files initialized playground-mysql | 2024-01-16 00:50:16+00:00 [Note] [Entrypoint]: Starting temporary server playground-hive | 0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-afc2c69be418.out playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 0.0.0.0: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | 2024-01-16T00:50:20.737332Z 0 [Warning] [MY-011068] [Server] The syntax '--skip-host-cache' is deprecated and will be removed in a future release. Please use SET GLOBAL host_cache_size=0 instead. playground-mysql | 2024-01-16T00:50:20.813032Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead. playground-mysql | 2024-01-16T00:50:20.813068Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.35) starting as process 124 playground-mysql | 2024-01-16T00:50:21.141604Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | 2024-01-16T00:50:23.142821Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended. playground-hive | 24/01/16 00:50:23 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | 2024-01-16T00:50:23.612886Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. playground-mysql | 2024-01-16T00:50:23.612917Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel. playground-mysql | 2024-01-16T00:50:23.617444Z 0 [Warning] [MY-011810] [Server] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory. playground-mysql | 2024-01-16T00:50:23.637193Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Socket: /var/run/mysqld/mysqlx.sock playground-mysql | 2024-01-16T00:50:23.637302Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.35' socket: '/var/run/mysqld/mysqld.sock' port: 0 MySQL Community Server - GPL. playground-mysql | 2024-01-16 00:50:23+00:00 [Note] [Entrypoint]: Temporary server started. playground-mysql | '/var/lib/mysql/mysql.sock' -> '/var/run/mysqld/mysqld.sock' playground-mysql | 2024-01-16T00:50:23.994297Z 8 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-hive | 24/01/16 00:50:24 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it. playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/leap-seconds.list' as time zone. Skipping it. playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it. playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 24/01/16 00:50:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it. playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it. playground-mysql | Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it. playground-hive | 24/01/16 00:50:31 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-mysql | 2024-01-16T00:50:32.278812Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16T00:50:32.346028Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16T00:50:32.483172Z 9 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16 00:50:32+00:00 [Note] [Entrypoint]: Creating database db playground-mysql | 2024-01-16T00:50:32.568955Z 10 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16 00:50:32+00:00 [Note] [Entrypoint]: Creating user mysql playground-mysql | 2024-01-16T00:50:32.644170Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16T00:50:32.648532Z 11 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16 00:50:32+00:00 [Note] [Entrypoint]: Giving user mysql access to schema db playground-mysql | 2024-01-16T00:50:32.712308Z 12 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | playground-mysql | 2024-01-16 00:50:32+00:00 [Note] [Entrypoint]: /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initdb.d/init.sql playground-mysql | 2024-01-16T00:50:32.769694Z 13 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | playground-mysql | playground-mysql | 2024-01-16 00:50:32+00:00 [Note] [Entrypoint]: Stopping temporary server playground-mysql | 2024-01-16T00:50:32.879509Z 14 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead' playground-mysql | 2024-01-16T00:50:32.952833Z 14 [System] [MY-013172] [Server] Received SHUTDOWN from user root. Shutting down mysqld (Version: 8.0.35). playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 24/01/16 00:50:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 24/01/16 00:50:39 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-mysql | 2024-01-16T00:50:40.023227Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.35) MySQL Community Server - GPL. playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 24/01/16 00:50:40 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-mysql | 2024-01-16 00:50:40+00:00 [Note] [Entrypoint]: Temporary server stopped playground-mysql | playground-mysql | 2024-01-16 00:50:40+00:00 [Note] [Entrypoint]: MySQL init process done. Ready for start up. playground-mysql | playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | 2024-01-16T00:50:42.211172Z 0 [Warning] [MY-011068] [Server] The syntax '--skip-host-cache' is deprecated and will be removed in a future release. Please use SET GLOBAL host_cache_size=0 instead. playground-mysql | 2024-01-16T00:50:42.283851Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead. playground-mysql | 2024-01-16T00:50:42.283890Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.35) starting as process 1 playground-mysql | 2024-01-16T00:50:42.443158Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. playground-hive | 24/01/16 00:50:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-mysql | 2024-01-16T00:50:43.904734Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended. playground-mysql | 2024-01-16T00:50:44.533476Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. playground-mysql | 2024-01-16T00:50:44.533533Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel. playground-mysql | 2024-01-16T00:50:44.536056Z 0 [Warning] [MY-011810] [Server] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory. playground-mysql | 2024-01-16T00:50:44.669628Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/run/mysqld/mysqlx.sock playground-mysql | 2024-01-16T00:50:44.670431Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.35' socket: '/var/run/mysqld/mysqld.sock' port: 3306 MySQL Community Server - GPL. playground-hive | 24/01/16 00:50:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | 24/01/16 00:50:48 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable playground-hive | chmod: /user/hive/tmp': No such file or directory playground-hive | usermod: no changes playground-hive | * Starting MySQL database server mysqld playground-hive | ...done. playground-hive | mysql: [Warning] Using a password on the command line interface can be insecure. playground-hive | OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0 playground-hive | SLF4J: Class path contains multiple SLF4J bindings. playground-hive | SLF4J: Found binding in [jar:file:/usr/local/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] playground-hive | SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] playground-hive | SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. playground-hive | SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] playground-hive | Metastore connection URL: jdbc:mysql://localhost/metastore_db?createDatabaseIfNotExist=true&useSSL=false playground-hive | Metastore Connection Driver : com.mysql.jdbc.Driver playground-hive | Metastore connection User: hive playground-hive | Loading classcom.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary. playground-hive | Starting metastore schema initialization to 2.3.0 playground-hive | Initialization script hive-schema-2.3.0.mysql.sql playground-hive | Initialization script completed playground-hive | schemaTool completed playground-gravitino | Start to download the jar package of JDBC playground-gravitino | --2024-01-16 00:51:50-- https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.27/mysql-connector-java-8.0.27.jar playground-gravitino | Resolving repo1.maven.org (repo1.maven.org)... 151.101.20.209, 2a04:4e42:5::209 playground-gravitino | Connecting to repo1.maven.org (repo1.maven.org)|151.101.20.209|:443... connected. playground-gravitino | HTTP request sent, awaiting response... 200 OK playground-gravitino | Length: 2475087 (2.4M) [application/java-archive] playground-gravitino | Saving to: ‘/root/gravitino/catalogs/jdbc-mysql/libs/mysql-connector-java-8.0.27.jar’ playground-gravitino | playground-gravitino | 0K .......... .......... .......... .......... .......... 2% 3.26M 1s playground-gravitino | 50K .......... .......... .......... .......... .......... 4% 4.44M 1s playground-gravitino | 100K .......... .......... .......... .......... .......... 6% 53.8M 0s playground-gravitino | 150K .......... .......... .......... .......... .......... 8% 4.13M 0s playground-gravitino | 200K .......... .......... .......... .......... .......... 10% 31.5M 0s playground-gravitino | 250K .......... .......... .......... .......... .......... 12% 3.36M 0s playground-gravitino | 300K .......... .......... .......... .......... .......... 14% 1.51M 1s playground-gravitino | 350K .......... .......... .......... .......... .......... 16% 7.11M 0s playground-gravitino | 400K .......... .......... .......... .......... .......... 18% 62.5M 0s playground-gravitino | 450K .......... .......... .......... .......... .......... 20% 37.6M 0s playground-gravitino | 500K .......... .......... .......... .......... .......... 22% 1.43M 0s playground-gravitino | 550K .......... .......... .......... .......... .......... 24% 25.7M 0s playground-gravitino | 600K .......... .......... .......... .......... .......... 26% 63.7M 0s playground-gravitino | 650K .......... .......... .......... .......... .......... 28% 137M 0s playground-gravitino | 700K .......... .......... .......... .......... .......... 31% 23.8M 0s playground-gravitino | 750K .......... .......... .......... .......... .......... 33% 1.46M 0s playground-gravitino | 800K .......... .......... .......... .......... .......... 35% 90.8M 0s playground-gravitino | 850K .......... .......... .......... .......... .......... 37% 34.1M 0s playground-gravitino | 900K .......... .......... .......... .......... .......... 39% 64.9M 0s playground-gravitino | 950K .......... .......... .......... .......... .......... 41% 2.61M 0s playground-gravitino | 1000K .......... .......... .......... .......... .......... 43% 1.54M 0s playground-gravitino | 1050K .......... .......... .......... .......... .......... 45% 12.9M 0s playground-gravitino | 1100K .......... .......... .......... .......... .......... 47% 12.0M 0s playground-gravitino | 1150K .......... .......... .......... .......... .......... 49% 10.9M 0s playground-gravitino | 1200K .......... .......... .......... .......... .......... 51% 2.46M 0s playground-gravitino | 1250K .......... .......... .......... .......... .......... 53% 78.9M 0s playground-gravitino | 1300K .......... .......... .......... .......... .......... 55% 49.2M 0s playground-gravitino | 1350K .......... .......... .......... .......... .......... 57% 37.1M 0s playground-gravitino | 1400K .......... .......... .......... .......... .......... 59% 8.76M 0s playground-gravitino | 1450K .......... .......... .......... .......... .......... 62% 12.4M 0s playground-gravitino | 1500K .......... .......... .......... .......... .......... 64% 204M 0s playground-gravitino | 1550K .......... .......... .......... .......... .......... 66% 1.82M 0s playground-gravitino | 1600K .......... .......... .......... .......... .......... 68% 21.0M 0s playground-gravitino | 1650K .......... .......... .......... .......... .......... 70% 25.8M 0s playground-gravitino | 1700K .......... .......... .......... .......... .......... 72% 7.02M 0s playground-gravitino | 1750K .......... .......... .......... .......... .......... 74% 13.5M 0s playground-gravitino | 1800K .......... .......... .......... .......... .......... 76% 24.4M 0s playground-gravitino | 1850K .......... .......... .......... .......... .......... 78% 24.4M 0s playground-gravitino | 1900K .......... .......... .......... .......... .......... 80% 25.9M 0s playground-gravitino | 1950K .......... .......... .......... .......... .......... 82% 93.7M 0s playground-gravitino | 2000K .......... .......... .......... .......... .......... 84% 54.0M 0s playground-gravitino | 2050K .......... .......... .......... .......... .......... 86% 21.1M 0s playground-gravitino | 2100K .......... .......... .......... .......... .......... 88% 22.8M 0s playground-gravitino | 2150K .......... .......... .......... .......... .......... 91% 47.0M 0s playground-gravitino | 2200K .......... .......... .......... .......... .......... 93% 22.6M 0s playground-gravitino | 2250K .......... .......... .......... .......... .......... 95% 11.3M 0s playground-gravitino | 2300K .......... .......... .......... .......... .......... 97% 17.0M 0s playground-gravitino | 2350K .......... .......... .......... .......... .......... 99% 8.92M 0s playground-gravitino | 2400K .......... ....... 100% 19.8M=0.3s playground-gravitino | playground-gravitino | 2024-01-16 00:51:51 (7.01 MB/s) - ‘/root/gravitino/catalogs/jdbc-mysql/libs/mysql-connector-java-8.0.27.jar’ saved [2475087/2475087] playground-gravitino | playground-gravitino | --2024-01-16 00:51:51-- https://jdbc.postgresql.org/download/postgresql-42.7.0.jar playground-gravitino | Resolving jdbc.postgresql.org (jdbc.postgresql.org)... 72.32.157.228, 2001:4800:3e1:1::228 playground-gravitino | Connecting to jdbc.postgresql.org (jdbc.postgresql.org)|72.32.157.228|:443... connected. playground-gravitino | HTTP request sent, awaiting response... 200 OK playground-gravitino | Length: 1077325 (1.0M) [application/java-archive] playground-gravitino | Saving to: ‘/root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar’ playground-gravitino | playground-gravitino | 0K .......... .......... .......... .......... .......... 4% 915K 1s playground-gravitino | 50K .......... .......... .......... .......... .......... 9% 939K 1s playground-gravitino | 100K .......... .......... .......... .......... .......... 14% 13.1M 1s playground-gravitino | 150K .......... .......... .......... .......... .......... 19% 1019K 1s playground-gravitino | 200K .......... .......... .......... .......... .......... 23% 3.41M 1s playground-gravitino | 250K .......... .......... .......... .......... .......... 28% 205M 0s playground-gravitino | 300K .......... .......... .......... .......... .......... 33% 73.0M 0s playground-gravitino | 350K .......... .......... .......... .......... .......... 38% 1.22M 0s playground-gravitino | 400K .......... .......... .......... .......... .......... 42% 26.2M 0s playground-gravitino | 450K .......... .......... .......... .......... .......... 47% 5.54M 0s playground-gravitino | 500K .......... .......... .......... .......... .......... 52% 230M 0s playground-gravitino | 550K .......... .......... .......... .......... .......... 57% 3.85M 0s playground-gravitino | 600K .......... .......... .......... .......... .......... 61% 162M 0s playground-gravitino | 650K .......... .......... .......... .......... .......... 66% 168M 0s playground-gravitino | 700K .......... .......... .......... .......... .......... 71% 48.0M 0s playground-gravitino | 750K .......... .......... .......... .......... .......... 76% 87.8K 0s playground-gravitino | 800K .......... .......... .......... .......... .......... 80% 44.9M 0s playground-gravitino | 850K .......... .......... .......... .......... .......... 85% 44.8M 0s playground-gravitino | 900K .......... .......... .......... .......... .......... 90% 25.7M 0s playground-gravitino | 950K .......... .......... .......... .......... .......... 95% 16.8M 0s playground-gravitino | 1000K .......... .......... .......... .......... .......... 99% 43.1M 0s playground-gravitino | 1050K .. 100% 3958G=0.8s playground-gravitino | playground-gravitino | 2024-01-16 00:51:53 (1.25 MB/s) - ‘/root/gravitino/catalogs/jdbc-postgresql/libs/postgresql-42.7.0.jar’ saved [1077325/1077325] playground-gravitino | playground-gravitino | Finish downloading playground-gravitino | Start the Gravitino Server playground-gravitino | playground-gravitino | Log dir doesn't exist, create /root/gravitino/logs playground-gravitino | Gravitino Server start success! playground-gravitino | Gravitino Server is running[PID:63] Gracefully stopping... (press Ctrl+C again to force) [+] Stopping 1/0 [+] Killing 0/0 ⠋ Container playground-postgresql Stopping 0.1s ✔ Container playground-trino Stopped 0.0s ⠋ Container playground-mysql Stopping 0.1s ⠋ Container playground-gravitino Stopping 0.1s ⠋ Container playground-postgresql Killing 0.1s ⠋ Container playground-mysql Killing 0.1s ⠋ Container playground-hive Killing 0.1s ⠋ Container playground-gravitino Killing 0.1s dependency failed to start: container playground-gravitino is unhealthy [+] Running 6/6 ✔ Container playground-mysql Removed 0.0s ✔ Container playground-trino Removed 0.0s ✔ Container playground-postgresql Removed 0.0s ✔ Container playground-gravitino Removed 0.0s ✔ Container playground-hive Removed 0.0s ✔ Network gravitino-playground_default Removed

abant07 commented 10 months ago

It still is failing it says the container playground-gravitino is unhealthy

justinmclean commented 10 months ago

It may just have been slow to start up. Could you give it another go?

If that doesn't work, edit `docker-compose.yaml' and under the healthcheck section for gravitino change the interval from 5s to 20s.

justinmclean commented 10 months ago

Another issue is that you may not have wget installed. What happens if you type wget in the terminal?

abant07 commented 10 months ago

Yeah I dont have wget, I will install that

justinmclean commented 10 months ago

@abant07 Did you have any luck in installing wget and getting further?

abant07 commented 10 months ago

Sorry, I just got back home. Yes it seems to be working. Thank you! Now for the actual bug, should I just experiment with creating a new metalake and updating the properties?

abant07 commented 10 months ago

Im a bit concerned, because in order to fix the bug, wouldn't I need to be able to run the code from the java code that wasn't working before? Becuase the playground doesn't have any source code that relates to the functionality of the app, it just is excutable files, so I won't be able to fix the bug

abant07 commented 10 months ago
Screenshot 2024-01-16 at 8 02 39 PM

Another "bug" that is occurring is when I click on create metalake, it populates the data with the previous datalake info. Rather, what should happen is when a user clicks on the button, it should clear all the info from the boxes. This is a simple fix, and I can do this as well. @justinmclean

abant07 commented 10 months ago

Would you be able to point me to the java file and HTML, CSS files that are associated with this page.

Also just out of curiosity does the create catalog pop up sheet have any problems with duplicate keys?

Screenshot 2024-01-16 at 8 09 19 PM
justinmclean commented 10 months ago

Great, you got it working. If you find any other bugs, please raise an issue, but you should check that the issue has not already been raised. The code for the Create Catalog dialog is CreateCatalogDialog.js in web/app/metalakes/.

abant07 commented 10 months ago

Great, Ill look into it. If I do make edits to it, how will I be able to test them in the playground. For example, I change some code, but I want to see if it works before I create a PR, how should I test it?

justinmclean commented 10 months ago

For the Web UI, most changes you see right away after you save changes to your file; for some changes, you may need to rebuild the Web UI with yarn build and then restart with yarn server.

abant07 commented 10 months ago

Oh so I can still clone the main repo with all the code (the one that was giving me Java errors before), and then just cd into the web directory and just type yarn server in the terminal, and it should run fine? It wont give me errors that the Java code is erroring?

justinmclean commented 10 months ago

Yes that will work fine.

abant07 commented 10 months ago

I a getting this error now after I cd into web and after building gravitino from the main code with all the java

web % yarn run server yarn run v1.22.21 error gravitino-web@: The engine "node" is incompatible with this module. Expected version ">=18.18.2". Got "18.17.1" error Commands cannot run with an incompatible environment. info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

justinmclean commented 10 months ago

You need to update your version of Node.js. A yarn build should do that, if not you can update it using brew upgrade nodejs or similar.

abant07 commented 10 months ago

Ok so it loads the page, but I get server connection errors. And this will probably mean I wont be able to create a datalake and add fields to test out the web app. Im pretty sure this is because of the Java code errors.

Failed to proxy http://localhost:8090/configs?_t=1705553495381 AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } ○ Compiling /favicon.ico/route ... Failed to proxy http://localhost:8090/api/metalakes?_t=1705553501388 AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } ✓ Compiled /favicon.ico/route in 20.8s Failed to proxy http://localhost:8090/configs?_t=1705553553979 AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } Failed to proxy http://localhost:8090/configs?_t=1705553571380 AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

] } AggregateError at internalConnectMultiple (node:net:1114:18) at afterConnectMultiple (node:net:1667:5) at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) { code: 'ECONNREFUSED',

Error: connect ECONNREFUSED ::1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '::1',
  port: 8090
},
Error: connect ECONNREFUSED 127.0.0.1:8090
    at createConnectionError (node:net:1634:14)
    at afterConnectMultiple (node:net:1664:40)
    at TCPConnectWrap.callbackTrampoline (node:internal/async_hooks:130:17) {
  errno: -61,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 8090
}

]

justinmclean commented 10 months ago

That probably means your playground is not running. (In particular, Gravitino on port 8090.) It's not because of the Java errors.

abant07 commented 10 months ago

Oh really? So are you saying I have to have my playground running while I cd into web and then start the server with yarn? And then I can access the web app on port 8090 and it should work?

justinmclean commented 10 months ago

Yes, that's correct. The Gravitino Web UI needs to communicate with Gravitinbo (on port 8090) in order to display metalakes, catalogs etc etc information.

abant07 commented 10 months ago

Ok that doesn't seem to be working, however, since I am just fixing the UI, I will just try my best to correct the Javascript for the bug, and it should be good. I am able to load up the UI by cd web and then yarn server, only drawback is I cannot do anything functionally since my backend is not working, but I think it should be fine.

Thanks

ch3yne commented 10 months ago

Hi @abant07 , The path to the latest code is${gravitino_root}/web/app/ui/metalakes/CreateCatalogDialog.js.

If your backend service is not running and only the frontend is running, opening the below link can be debugged. http://localhost:8090/ui/metalakes?metalake=xxx

abant07 commented 10 months ago

Ok thank you.

Would you know however why my backend is not working. I believe that gravitino libraries are not importing correctly and that's what's causing the errors. Because if I can get my backend to work, then I can work on other issues in the repo after this one that deal with the backend if needed.

abant07 commented 10 months ago

Ok fortunately, the front end part wasn't too bad to deal with, so I was able to solve the bug. I have opened a pull request.

Thanks for sticking with me while I was troubleshooting. I will try to look into how I can fix my backend, because I would love to contribute to more issues in this repo!

Thanks, Amogh