JetBrains / teamcity-deployer-plugin

Deployer plugin for TeamCity CI server
http://confluence.jetbrains.net/display/TW/Deployer+plugin
Apache License 2.0
39 stars 29 forks source link

Partial Uploads for FTP Deploy #38

Closed nskvortsov closed 9 years ago

nskvortsov commented 9 years ago

I am trying to get the FTP deployer plugin working and I can't tell what is going on at all. It seems the FTP task runs for a little while and uploads some files to the FTP server but then just stops and the build finishes as successful with nothing in the build log to indicate what happened.

See attachments for build config screenshot and build log. Relevant lines from build log:

[21:27:32] : Step 3/3: FTP (FTP Deployer) (3m:22s) [21:27:33] : [Step 3/3] ##teamcity[buildStatisticValue key='buildStageDuration:buildStepRUNNER_9' value='0.0'] [21:27:33] : [Step 3/3] Starting upload via FTP to ftp://waws-prod-blu-001.ftp.azurewebsites.windows.net [21:30:55] : [Step 3/3] ##teamcity[buildStatisticValue key='buildStageDuration:buildStepRUNNER_9'

Let me know if you need anymore information.


nskvortsov commented 9 years ago

So, I guess you do not have all the files transferred?

Please, enable debug logs on the build agent (see this manual), re-run your build, attach resulting teamcity-agent.log file here.

Also, FTP server log file would be useful (but I do not know if it is available on Azure)


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Here is the agent log. I ran the build twice, once with FTPS and then with just plain FTP. Results are the same either way - build finishes successful but only a handful of files are actually uploaded with no indication in the build log as to what happened.


Original comment by: Chad Lee

nskvortsov commented 9 years ago

I don't know if this is related, but I'm getting partial uploads and constant "it.sauronsoftware.ftp4j.FTPException [code=450, message= Transfer aborted. Link to file server lost]" errors, even though none of my details have changed. This error used to happen occasionally, but I've had 20 failed deploys in a row now, and I'm scratching my head. Last time I looked, it seemed to upload 400KB of data, and then falls over. I logged onto the buildagent machine and used windows file transfer to test the connection and manually upload the file, didn't have a problem. Kinda stumped.


Original comment by: John Beech

nskvortsov commented 9 years ago

Thanks for the attached logs.

Could you please, downolad this build of the plugin and again collect agent debug logs? New build contains only fixes in errors logging, so do not expect FTP to start working.


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Did anyone have an opportunity to try new build of the plugin? I really need some more details to get the problem fixed.

Also, an FTP server log would be very useful.


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Hi Nikita,

I downloaded the latest build of the deployer and reran the build. See attached for two logs. The build log did show an error message this time:

Exception while uploading files: Client not connected


Original comment by: Chad Lee

nskvortsov commented 9 years ago

My problem cleared itself after a couple of hours, so I'm going to put it down to network problems. It's done 20 straight uploads with no problems since.


Original comment by: John Beech

nskvortsov commented 9 years ago

@chadly thank you for the logs. What I see is that remote host (azure vm in this case) has closed the connection. Could you please take a look at relevant part of Azure's ftp server log? It may contain some information on the cause of such behaviour.


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Hi, I've the same problem but with Azure Website (not VM). Basically my node_modules folder is copied partially.

Any idea?


Original comment by: imperugo

nskvortsov commented 9 years ago

My original issue is also FTPing to an azure website. I'll look and see if I can pull some logs from the server somehow.


Original comment by: Chad Lee

nskvortsov commented 9 years ago

For now I fixed using this http://teamcityrunners.codeplex.com/


Original comment by: imperugo

nskvortsov commented 9 years ago

fix issue #38 wait for FTP upload process to finish.

→ <<cset 0c698f7241a2>>


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Hi all, Sorry it took so long. I have found and fixed the issue. The new build will be available soon.


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Fixed in this build: https://teamcity.jetbrains.com/guestAuth/repository/download/bt402/169728:id/deploy-runner.zip?guest=1


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Issue #44 was marked as a duplicate of this issue.


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Default WaitFor() util has a timeout of 2 minutes. Added explicit timeout value


Original comment by: Nikita Skvortsov

nskvortsov commented 9 years ago

Issue #33 was marked as a duplicate of this issue.


Original comment by: Nikita Skvortsov