apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://dolphinscheduler.apache.org/
Apache License 2.0
12.4k stars 4.49k forks source link

[Bug] [plugin] can not load env/dolphinscheduler_env.sh #16133

Closed sdvdxl closed 2 weeks ago

sdvdxl commented 2 weeks ago

Search before asking

What happened

set export SEATUNNEL_HOME="${SEATUNNEL_HOME:-/opt/seatunnel-2.3.5}" in bin/env/dolphinscheduler_env.sh task log report :

/tmp/dolphinscheduler/exec/process/default/13865082550688/13865121489568_4/21/23/21_23.sh:行4: /bin/seatunnel.sh: 没有那个文件或目录

What you expected to happen

should execute correct exec seatunnel command

How to reproduce

  1. set export SEATUNNEL_HOME="${SEATUNNEL_HOME:-/opt/seatunnel-2.3.5}" in bin/env/dolphinscheduler_env.sh
  2. start server bin/dolphinscheduler-daemon.sh start standalone-server
  3. create project and seatunnel task
  4. run the job

Anything else

I found the pr Add source env list in common.properties,but not auto load dolphinscheduler_env.sh file, only load the specify explicitly env files

Version

3.2.x

Are you willing to submit PR?

Code of Conduct

github-actions[bot] commented 2 weeks ago

Search before asking

What happened

set export SEATUNNEL_HOME="${SEATUNNEL_HOME:-/opt/seatunnel-2.3.5}" in bin/env/dolphinscheduler_env.sh task log report :

/tmp/dolphinscheduler/exec/process/default/13865082550688/13865121489568_4/21/23/21_23.sh:行4: /bin/seatunnel.sh: 没有那个文件或目录

What you expected to happen

should execute correct exec seatunnel command

How to reproduce

  1. set export SEATUNNEL_HOME="${SEATUNNEL_HOME:-/opt/seatunnel-2.3.5}" in bin/env/dolphinscheduler_env.sh
  2. start server bin/dolphinscheduler-daemon.sh start standalone-server
  3. create project and seatunnel task
  4. run the job

Anything else

I found the pr Add source env list in common.properties,but not auto load dolphinscheduler_env.sh file, only load the specify explicitly env files

Version

3.2.x

Are you willing to submit PR?

Code of Conduct

blueflower1 commented 2 weeks ago

这里我直接配置了seatunnel的全局环境变量,这样配置文件在读取到${SEATUNNEL_HOME}时就正常了

sdvdxl commented 2 weeks ago

这里我直接配置了seatunnel的全局环境变量,这样配置文件在读取到${SEATUNNEL_HOME}时就正常了

@blueflower1 你这是什么版本,我用的3.2.0和3.2.1都需要手动在common配置中配置。 以前3.1.x版本,没有这个配置,可以直接使用环境变量

blueflower1 commented 2 weeks ago

我使用的是3.2.1,我是直接在/etc/profile.d/env.sh中配置了seatunnel的环境变量

blueflower1 commented 2 weeks ago

seatunnel和你一样也是2.3.5

sdvdxl commented 2 weeks ago

你这样配置应该是使用了默认的系统环境变量。 按照文档说在 dolphinscheduler_env.sh 中配置,没有被配置到系统环境变量中,没有读取到

SbloodyS commented 2 weeks ago

You need to use absolute paths instead of relative paths.

sdvdxl commented 2 weeks ago

You need to use absolute paths instead of relative paths.

怎么配置?在哪配置绝对路径? 怎么这么快关闭了?