hdfs -dfs does not let run multiple hdfs commands in one hop? How to bypass this ?

Netflix / genie

Distributed Big Data Orchestration Service

https://netflix.github.io/genie

Apache License 2.0

1.71k stars 367 forks source link

Closed Rustem closed 2 years ago

Rustem commented 2 years ago

HI Netflix team,

Looks like i have to execute multiple genie jobs to execute a logic similar to below. Is there way i can smartly club all of them in a single job?

hdfs -dfs ls
hdfs -dfs mkdir
hdfs -dfs copyFromLocal

Rustem commented 2 years ago

It is by design