Closed magicDGS closed 6 years ago
A new check on startup for the _SUCCESS file (if it is a HDFS path) should throw an UserException to show that the job was not successful. We can add also an @Advance argument (--disable-success-check) to proceed even if the file is not present.
_SUCCESS
UserException
@Advance
--disable-success-check
Related with https://github.com/robmaz/distmap/issues/88
A new check on startup for the
_SUCCESS
file (if it is a HDFS path) should throw anUserException
to show that the job was not successful. We can add also an@Advance
argument (--disable-success-check
) to proceed even if the file is not present.