search

pixelcog / opsworks-vm

Virtual machine templates for AWS OpsWorks running on Ubuntu 12.04 and 14.04
MIT License
60 stars 22 forks source link

Random "File size test failed" errors during "rake build" #16

Closed djcp closed 8 years ago

djcp commented 8 years ago

So I've updated the OPSWORKS_AGENT_VERSION to be the latest stable (though I'm not sure if that's relevant) and I get intermittent errors during the agent install that fail the build.

What's frustrating is that sometimes this works and sometimes it doesn't. The error is probably being thrown from aws-managed code, but it's odd that it has intermittent failures in this environment.

Thoughts?

    virtualbox-iso: ~/opsworks-installer.MnwVBv8H ~
    virtualbox-iso: Installing OpsWorks agent version 3433-20160227053027
    virtualbox-iso: 2016-03-18 13:40:46 URL:https://opsworks-instance-agent.s3.amazonaws.com/3433-20160227053027/opsworks-agent-installer.tgz [6627691/6627691] -> "opsworks-agent-installer.tgz" [1]
    virtualbox-iso: Using opsworks-instance-assets.s3.amazonaws.com for assets.
    virtualbox-iso: Downloading agent ruby package
    virtualbox-iso: [Fri, 18 Mar 2016 13:40:46 +0000] downloader: Successfully created temporary download directory. (/tmp/opsworks-downloader.qYcgHojc)
    virtualbox-iso: [Fri, 18 Mar 2016 13:42:46 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:42:46 +0000] downloader: Retrying download after 0 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:42:46 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:44:47 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:44:47 +0000] downloader: Retrying download after 5 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:44:52 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:46:52 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:46:52 +0000] downloader: Retrying download after 10 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:47:02 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:49:02 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:49:02 +0000] downloader: Retrying download after 15 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:49:17 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:51:17 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:51:17 +0000] downloader: Retrying download after 20 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:51:37 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:53:37 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:53:37 +0000] downloader: Retrying download after 25 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:54:02 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:56:02 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:56:02 +0000] downloader: Retrying download after 30 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:56:32 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
    virtualbox-iso: [Fri, 18 Mar 2016 13:58:33 +0000] downloader: [ERROR] File size test failed. HTTP/1.1 200 OK url: https://opsworks-instance-assets.s3.amazonaws.com/packages/ubuntu/14.04/opsworks-agent-ruby_2.0.0-p645-1_amd64.deb
    virtualbox-iso: [Fri, 18 Mar 2016 13:58:33 +0000] downloader: Retrying download after 35 seconds
    virtualbox-iso: [Fri, 18 Mar 2016 13:59:08 +0000] downloader: Deleting content of directory /tmp/opsworks-downloader.qYcgHojc
chuangtim commented 8 years ago

+1,I also encounter this. @djcp are you solve the problem ?

chuangtim commented 8 years ago

@mikegreiling

djcp commented 8 years ago

I solved it by switching to using the "virtio" nic in template/ubuntu1404.json. This driver GREATLY improves networking performance in vagrant VMs on linux (and maybe other host OSs, I don't know).

https://github.com/harvard-dce/opsworks-vm/commit/666936abf4dfd5da69574aab2d015889e75a8727

chuangtim commented 8 years ago

@djcp good job,thanks for your answer,I will try it as you say,

mikegreiling commented 8 years ago

Thanks, sorry I didn't notice this issue in my notifications. I'm glad you've figured something out!

I haven't run into this issue myself, are both of you using Linux as your host OS?

chuangtim commented 8 years ago

@djcp I had not sovled that problem，it can`t work as you say. @mikegreiling can you reproduce this problem? I had tried any way.any thoughts?

djcp commented 8 years ago

@mikegreiling I'm using debian jessie as my host OS. The virtio nic modification was like night and day in terms of virtualbox networking performance. HUGE improvement.