apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://dolphinscheduler.apache.org/
Apache License 2.0
12.8k stars 4.6k forks source link

[Bug][Module Name] sqoop任务中途退出,exit before timeout, exit value:127 #3569

Closed gaoyu2016 closed 4 years ago

gaoyu2016 commented 4 years ago

使用调度: java -jar ds-sqoop.jar --spring.profiles.active=test --jobs.active=TaskRunnerJob 361 报错信息: 2020-08-21 11:11:18 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] commands:cd /home/shared/ds-sqoop/tmp; sqoop --options-file /home/shared/ds-sqoop/config/pipe_sqoop_task_config > /home/shared/ds-sqoop/log/sqoop/pipe_sqoop_task_log 2>&1 2020-08-21 11:11:18 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] exit before timeout, exit value:127 但是: 直接执行jar包,不会中途退出。 2020-08-21 14:38:10 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] cmd:sqoop --options-file /home/shared/ds-sqoop/config/pipe_sqoop_task_config 2020-08-21 14:38:10 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] commands:cd /home/shared/ds-sqoop/tmp; sqoop --options-file /home/shared/ds-sqoop/config/pipe_sqoop_task_config > /home/shared/ds-sqoop/log/sqoop/pipe_sqoop_task_log 2>&1 2020-08-21 14:41:00 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] exit before timeout, exit value:0

yangyichao-mango commented 4 years ago

Which version? This maybe is your business error according the log. You should first check what the cause of 127 image

gaoyu2016 commented 4 years ago

1.3.1 最新版本。 不通过调度系统,我java -jar ds-sqoop.jar --spring.profiles.active=test --jobs.active=TaskRunnerJob 361是没问题的。 exit before timeout, exit value:0

2020-08-21 14:38:10 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] cmd:sqoop --options-file /home/shared/ds-sqoop/config/pipe_sqoop_task_config 2020-08-21 14:38:10 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] commands:cd /home/shared/ds-sqoop/tmp; sqoop --options-file /home/shared/ds-sqoop/config/pipe_sqoop_task_config > /home/shared/ds-sqoop/log/sqoop/pipe_sqoop_task_log 2>&1 2020-08-21 14:41:00 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] exit before timeout, exit value:0

davidzollo commented 4 years ago

you can try set absolute path for ds-sqoop.jar

gaoyu2016 commented 4 years ago

I set absolute path for ds-sqoop.jar test -d /home/shared/ds-sqoop || mkdir -p /home/shared/ds-sqoop test -d /home/shared/ds-sqoop/log/sqoop || mkdir -p /home/shared/ds-sqoop/log/sqoop test -d /home/shared/ds-sqoop/config || mkdir -p /home/shared/ds-sqoop/config test -d /home/shared/ds-sqoop/tmp || mkdir -p /home/shared/ds-sqoop/tmp java -jar /home/maintain/gaobaoyuan/ds-sqoop.jar --spring.profiles.active=test --jobs.active=TaskRunnerJob 361 image

but: 2020-08-24 15:14:11 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] commands:cd /home/shared/ds-sqoop/tmp; sqoop --options-file /home/shared/ds-sqoop/config/pipe_sqoop_task_config > /home/shared/ds-sqoop/log/sqoop/pipe_sqoop_task_log 2>&1 2020-08-24 15:14:11 [INFO] [main] [com.fenbi.ds.sqoop.service.CmdLineRunner] exit before timeout, exit value:127 仍然有问题exit before timeout, exit value:127