apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
https://kyuubi.apache.org/
Apache License 2.0
2.07k stars 902 forks source link

[Bug] kyuubi.kubernetes.spark.appUrlPattern not effective when use beeline submit spark sql #6622

Open wkjoinGit opened 1 month ago

wkjoinGit commented 1 month ago

Code of Conduct

Search before asking

Describe the bug

set kyuubi conf kyuubi.kubernetes.spark.appUrlPattern=http://{{SPARK_APP_ID}}.ingress.balabala, use beeline submit spark sql, then application web UI not change.

2024-08-16 00:51:28.548 INFO SparkSQLSessionManager-exec-pool: Thread-114 org.apache.kyuubi.engine.spark.operation.ExecuteStatement: Spark application name: kyuubi_CONNECTION_SPARK_SQL_hive_bc377e04-97c1-449e-bce9-2f403bbd89d8 application ID: spark-01ac14cdb2944486940a89cc53c417c7 application web UI: http://spark-18509e9158a93712-driver-svc.kyuubi-spark.svc:4040 master: k8s://https://10.43.0.1:443 deploy mode: cluster version: 3.4.1 Start time: 2024-08-16T00:49:38.705 User: hive

Affects Version(s)

master

Kyuubi Server Log Output

No response

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

No response

Kyuubi Engine Configurations

No response

Additional context

No response

Are you willing to submit PR?

github-actions[bot] commented 1 month ago

Hello @wkjoinGit, Thanks for finding the time to report the issue! We really appreciate the community's efforts to improve Apache Kyuubi.

pan3793 commented 4 weeks ago

Thanks for reporting it, https://github.com/apache/kyuubi/pull/6318 introduced kyuubi.kubernetes.spark.appUrlPattern to solve the batch Spark app URL cases, which is also supposed to work for interactive sessions, will check it later.