KITE-1065: Add support for Oozie delegation tokens.

kite-sdk / kite

Kite SDK

http://kitesdk.org/docs/current/

Apache License 2.0

394 stars 263 forks source link

KITE-1065: Add support for Oozie delegation tokens. #408

Closed rdblue closed 9 years ago

rdblue commented 9 years ago

Oozie passes delegation tokens via HADOOP_TOKEN_FILE_LOCATION. This adds support to pick up those tokens and add them to the DefaultConfiguration.

rdblue commented 9 years ago

@rkanter and @bbrownz, can you review this?

rkanter commented 9 years ago

Looks good to me +1

bbrownz commented 9 years ago

+1 from me as well. Tagging @mkwhitacre as well. I believe he made the addition for the static block on https://issues.cloudera.org/browse/KITE-462 although I'm not sure if he has run into issues with the token file as well.

bbrownz commented 9 years ago

Site note: it looks like KITE-462 might have missed being tagged with 1.1.0 where Micah's changes went in.

mkwhitacre commented 9 years ago

+1 for the change as I'm pretty sure it is innocuous or should have minimal impact. I'm curious where this error presented itself because we've been running without it on a secure cluster and communicating between two instances just fine.

Outside of Kite the only place I know this is a requirement is HBase[1] [1] - https://github.com/apache/hbase/blob/4f410e6bd5406eacbfae98d21786dfc24cb57f1b/hbase-server/src/main/java/org/apache/hadoop/hbase/mapred/TableMapReduceUtil.java#L265