We have a Windows build agent which run an SSH Exec command "rm -rf /tmp/%system.teamcity.buildType.id%" on a linux server using password Authentication method.
It is stalling at this steps and would not finish.
I logged into the build agent and was able to ping the target linux server, Putty SSH into the server with the credential used. I was able to run that command on the server with that credential once SSHed in.
I ran this process about 10+ times now and it keeps stalling at this steps.
I turned on Debugging and this is what I see.
Any idea what it is and how to fix it?
[2016-04-29 11:21:14,128] DEBUG - jetbrains.buildServer.XMLRPC - <<< XML-RPC response <<< [2016-04-29 11:21:14,128] DEBUG - jetbrains.buildServer.XMLRPC - <?xml version="1.0"?><methodResponse><params><param><value><boolean>1</boolean></value></param></params></methodResponse> [2016-04-29 11:21:14,128] DEBUG - r.agent.impl.AgentLogProxyImpl - Action "14 log messages" performed for build id=27568 [2016-04-29 11:21:15,175] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:21:18,019] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:18,722] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:19,129] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:19,129] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:24,132] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:24,132] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:28,023] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:28,738] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:29,144] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:29,144] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:34,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:34,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:35,754] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:21:38,035] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:38,754] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:39,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:39,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:44,177] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:44,177] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:48,043] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:48,762] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:49,184] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:49,184] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:54,200] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:54,200] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:56,310] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:21:58,060] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:58,779] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:59,206] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:59,206] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:04,214] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:04,214] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:08,073] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:08,788] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:09,226] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:09,226] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:14,231] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:14,231] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:16,875] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:22:18,078] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:18,797] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:19,235] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:19,235] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:24,251] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:24,251] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:28,093] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:28,811] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:29,265] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:29,265] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:34,281] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:34,281] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:37,453] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server
Hope you can shed some light to fix this issue.
We have a Windows build agent which run an SSH Exec command "rm -rf /tmp/%system.teamcity.buildType.id%" on a linux server using password Authentication method.
It is stalling at this steps and would not finish.
I logged into the build agent and was able to ping the target linux server, Putty SSH into the server with the credential used. I was able to run that command on the server with that credential once SSHed in.
I ran this process about 10+ times now and it keeps stalling at this steps.
I turned on Debugging and this is what I see.
Any idea what it is and how to fix it?
[2016-04-29 11:21:14,128] DEBUG - jetbrains.buildServer.XMLRPC - <<< XML-RPC response <<< [2016-04-29 11:21:14,128] DEBUG - jetbrains.buildServer.XMLRPC - <?xml version="1.0"?><methodResponse><params><param><value><boolean>1</boolean></value></param></params></methodResponse> [2016-04-29 11:21:14,128] DEBUG - r.agent.impl.AgentLogProxyImpl - Action "14 log messages" performed for build id=27568 [2016-04-29 11:21:15,175] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:21:18,019] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:18,722] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:19,129] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:19,129] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:24,132] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:24,132] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:28,023] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:28,738] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:29,144] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:29,144] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:34,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:34,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:35,754] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:21:38,035] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:38,754] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:39,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:39,160] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:44,177] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:44,177] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:48,043] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:48,762] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:49,184] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:49,184] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:54,200] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:54,200] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:21:56,310] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:21:58,060] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:58,779] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:21:59,206] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:21:59,206] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:04,214] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:04,214] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:08,073] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:08,788] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:09,226] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:09,226] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:14,231] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:14,231] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:16,875] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server [2016-04-29 11:22:18,078] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:18,797] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:19,235] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:19,235] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:24,251] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:24,251] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:28,093] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:28,811] DEBUG - ins.buildServer.ChangeObserver - Finished detecting changes in 0ms for File watcher for "..\conf\buildAgent.properties" [2016-04-29 11:22:29,265] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:29,265] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:34,281] DEBUG - r.agent.impl.AgentLogProxyImpl - Flush messages for AgentLogProxyImpl::executor [2016-04-29 11:22:34,281] DEBUG - r.agent.impl.AgentLogProxyImpl - Later executor invocation for 0 remote commands, requestor: AgentLogProxyImpl::executor [2016-04-29 11:22:37,453] DEBUG - jetbrains.buildServer.AGENT - Agent ping from server