apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
https://linkis.apache.org/
Apache License 2.0
3.27k stars 1.15k forks source link

[Bug] [1.5.0]The display of the HBase result should be Optimized #5031

Closed gjy1043 closed 7 months ago

gjy1043 commented 7 months ago

Search before asking

Linkis Component

linkis-computation-governance

Steps to reproduce

[hadoop@wds05 LinkisInstall150_t2]$ sh bin/linkis-cli -engineType hbase-2.5.3 -code "list" -codeType shell -runtimeMap linkis.hbase.zookeeper.quorum=172.16.16.15:2181,172.16.16.4,172.16.16.10=====Java Start Command===== exec /data/apps/jdk1.8.0_192/bin/java -server -Xms32m -Xmx2048m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/appcom/Install/LinkisInstall150_t2/logs/linkis-cli -XX:ErrorFile=/appcom/Install/LinkisInstall150_t2/logs/linkis-cli/ps_err_pid%p.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+DisableExplicitGC -classpath /appcom/Install/LinkisInstall150_t2/conf/linkis-cli:/appcom/Install/LinkisInstall150_t2/lib/linkis-computation-governance/linkis-client/linkis-cli/:/appcom/Install/LinkisInstall150_t2/lib/linkis-commons/public-module/:/data/apps/apache-jmeter-5.5/lib/ext/ApacheJMeter_core.jar:/data/apps/apache-jmeter-5.5/lib/jorphan.jar:/data/apps/apache-jmeter-5.5/lib/logkit-2.0.jar: -Dconf.root=/appcom/Install/LinkisInstall150_t2/conf/linkis-cli -Dconf.file=linkis-cli.properties -Dlog.path=/appcom/Install/LinkisInstall150_t2/logs/linkis-cli -Dlog.file=linkis-client.hadoop.log.20231212141152090506985 org.apache.linkis.cli.application.LinkisClientApplication '-engineType hbase-2.5.3 -code list -codeType shell -runtimeMap linkis.hbase.zookeeper.quorum=172.16.16.15:2181,172.16.16.4,172.16.16.10' [INFO] LogFile path: /appcom/Install/LinkisInstall150_t2/logs/linkis-cli/linkis-client.hadoop.log.20231212141152090506985 [INFO] User does not provide usr-configuration file. Will use default config [INFO] user does not specify submit-user, will use current Linux user "hadoop" by default. [INFO] user does not specify proxy-user, will use current submit-user "hadoop" by default. [INFO] connecting to linkis gateway:http://127.0.0.1:9001 JobId:408 TaskId:408 ExecId:exec_id018010linkis-cg-entrancewds05:9104LINKISCLI_hadoop_hbase_0 [INFO] Job is successfully submitted!

2023-12-12 14:11:53.011 INFO Program is substituting variables for you 2023-12-12 14:11:53.011 INFO Variables substitution ended successfully 2023-12-12 14:11:53.011 INFO You have submitted a new job, script code (after variable substitution) is ****SCRIPT CODE**** list ****SCRIPT CODE**** 2023-12-12 14:11:53.011 WARN The code you submit will not be limited by the limit 2023-12-12 14:11:53.011 INFO Job with jobId : 408 and execID : LINKISCLI_hadoop_hbase_0 submitted 2023-12-12 14:11:53.011 INFO Your job is accepted, jobID is LINKISCLI_hadoop_hbase_0 and jobReqId is 408 in ServiceInstance(linkis-cg-entrance, wds05:9104, 0). Please wait it to be scheduled 2023-12-12 14:11:53.011 INFO Your job is Scheduled. Please wait it to run. 2023-12-12 14:11:53.011 INFO job is scheduled. 2023-12-12 14:11:53.011 INFO Your job is being scheduled by orchestrator. 2023-12-12 14:11:53.011 INFO Your job is Running now. Please wait it to complete. 2023-12-12 14:11:53.011 INFO job is running. 2023-12-12 14:11:53.011 INFO JobRequest (408) was submitted to Orchestrator. 2023-12-12 14:11:53.011 INFO Background is starting a new engine for you,execId TaskID_408_otJobId_astJob_403_codeExec_403 mark id is mark_457, it may take several seconds, please wait 2023-12-12 14:11:53.011 INFO Request LinkisManager:org.apache.linkis.manager.common.protocol.engine.EngineAskAsyncResponse@36d9e83 2023-12-12 14:12:08.012 INFO Succeed to create new ec : ServiceInstance(linkis-cg-engineconn, wds05:39199, 0) 2023-12-12 14:12:08.012 INFO Task submit to ec: ServiceInstance(linkis-cg-engineconn, wds05:39199, 0) get engineConnExecId is: 1 hdfs:///tmp/linkis/hadoop/linkis/2023-12-12/141153/LINKISCLI/408/_0.dolphin 2023-12-12 14:12:20.012 INFO Congratulations! Your job : LINKISCLI_hadoop_hbase_0 executed with status succeed and 2 results. 2023-12-12 14:12:20.012 INFO Task creation time(任务创建时间): 2023-12-12 14:11:53, Task scheduling time(任务调度时间): 2023-12-12 14:11:53, Task start time(任务开始时间): 2023-12-12 14:11:53, Mission end time(任务结束时间): 2023-12-12 14:12:20 2023-12-12 14:12:20.012 INFO Task submit to Orchestrator time:2023-12-12 14:11:53, Task request EngineConn time:2023-12-12 14:11:53, Task submit to EngineConn time:2023-12-12 14:12:08 2023-12-12 14:12:20.012 INFO Your mission(您的任务) 408 The total time spent is(总耗时时间为): 27.0 s 2023-12-12 14:12:20.012 INFO Congratulations. Your job completed with status Success.

[INFO] Job execute successfully! Will try get execute result ============Result:================ TaskId:408 ExecId: exec_id018010linkis-cg-entrancewds05:9104LINKISCLI_hadoop_hbase_0 User:hadoop Current job status:SUCCEED extraMsg: result:

[INFO] Retrieving result-set, may take time if result-set is large, please do not exit program. ============ RESULT SET 1 ============ TABLE
t.a
t1
tt
test:tab.hql
4 row(s) Took 0.0117 seconds

############Execute Success!!!########

image

Expected behavior

rows and time should not be displayed in the result

Your environment

Anything else

No response

Are you willing to submit a PR?

github-actions[bot] commented 7 months ago

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

Name Description Subscribe Unsubscribe Archive
dev@linkis.apache.org community activity information subscribe unsubscribe archive