randerzander / docker-hdp

Dockerized HDP Cluster
84 stars 53 forks source link

Ambari Agent Cache Issue while registering Nodes to ambari serve #8

Closed sarath-mec closed 7 years ago

sarath-mec commented 7 years ago

INFO 2017-03-29 19:14:00,756 ActionQueue.py:118 - Adding EXECUTION_COMMAND for role check_host for service null of cluster null to the queue. INFO 2017-03-29 19:14:00,770 ActionQueue.py:254 - Executing command with id = 1-0, taskId = 3 for role = check_host of cluster null. INFO 2017-03-29 19:14:00,770 ActionQueue.py:295 - Command execution metadata - taskId = 3, retry enabled = False, max retry duration (sec) = 0, log_output = True WARNING 2017-03-29 19:14:00,772 CommandStatusDict.py:128 - [Errno 2] No such file or directory: '/var/lib/ambari-agent/data/output-3.txt' WARNING 2017-03-29 19:14:00,784 FileCache.py:168 - Error occurred during cache update. Error tolerate setting is set to true, so ignoring this error and continuing with current cache. Error detai ls: ('Can not invalidate cache directory {0}: {1}', '/var/lib/ambari-agent/cache/custom_actions', "[Errno 39] Directory not empty: '/var/lib/ambari-agent/cache/custom_actions/scripts'") INFO 2017-03-29 19:14:00,813 PythonExecutor.py:130 - Command ['/usr/bin/python',

I have put a sleep command in the script so that the HDP nodes wait for 2 minutes after ambari-server is up.

Upon checking the docker exec -it bash, I am able to find the file. But upon registering the nodes in ambari server, I am getting error

sarath-mec commented 7 years ago

Issue marked as closed as I tired docker compose of Google Cloud Engine. It is not compatible with docker yet. In any sample docker training image if we run on google container and if we try to delete any file. It will not be deleted propely in Google Container docker exec -it bash InsideContainer: rm

Does not delete. I even tried using Google Container Optimized Docker and it also has compatiilty issues

For docker to be running fine in google PAAS, we have to use Google Container engine, which I have not explored much.

Finally I was able to bring it up in Microsoft Azure PAAS