Need output "Nothing to do" for hdfs related steps

Factual / drake

Data workflow tool, like a "Make for data"

Other

1.48k stars 110 forks source link

Need output "Nothing to do" for hdfs related steps #167

Open mavericklou opened 9 years ago

mavericklou commented 9 years ago

In this case, it is really "Nothing to do". Should output "Nothing to do" instead of being silence.

amalloy commented 9 years ago

Looks like a bug to me. I don't know the hdfs part of drake as well as I know some other parts, though, and I don't actually know how to use hdfs at all to test it myself. Maybe @dirtyvagabond has some idea what might be different about hdfs inputs compared to local inputs, when considering what targets to build?

BMayneFactual commented 9 years ago

seems to not be working for me (as opposed to just silent).

ben-dev-temp-e49 ~ $ cat test.d
text.txt <- hdfs:/user/benmayne/test.txt [shell]
  hadoop fs -cat $INPUT > $OUTPUT

text2.txt <- [shell]
  echo "test" > $OUTPUT
ben-dev-temp-e49 ~ $ ls test*
test.d
ben-dev-temp-e49 ~ $ drake -w test.d
Using DRAKE_HOME: /home/benmayne/code/drake/
ben-dev-temp-e49 ~ $ ls test*
test.d
ben-dev-temp-e49 ~ $ hadoop fs -cat /user/benmayne/test.txt
test
ben-dev-temp-e49 ~ $

BMayneFactual commented 9 years ago

fyi, I'm seeing the same result (no output, just silently existing) when I've got syntax or other errors in c4rows protocol where it used to have an error message.