kite-sdk / kite

Kite SDK
http://kitesdk.org/docs/current/
Apache License 2.0
394 stars 265 forks source link

Root temp directory path is now configurable in HiveAbstractDatasetRe… #487

Closed szvasas closed 5 years ago

szvasas commented 5 years ago

…pository

When importing data into Hive Kite creates a temporary directory in /tmp and if the import is successful it moves the data into the Hive warehouse. However on a secure cluster if a /tmp and the Hive warehouse directories are in separate encryption zones this move fails because the 2 directories are encrypted with different keyes and the move operation is not supported. This change introduces a configuration key which enables the users to set the path of the temporary directory.