Closed michaelklishin closed 12 years ago
Do you have any ideas how I could fix this? It's a small spec suite I'm not sure why this is hanging. It was all passing fine, and then just stopped working. I posted to https://github.com/travis-ci/travis-ci/issues/317#issuecomment-2972243
Thanks.
On Thu, Dec 1, 2011 at 6:03 AM, Michael Klishin reply@reply.github.com wrote:
Your test suite hangs on travis-ci.org (see for example). We have to ask you either to fix this issue or disable travis-ci hook (Admin => Service Hooks) because every push to your project locks up 6 workers for 30 minutes (our current build timeout value). We cannot lower build timeout at this point because projects like Diaspora take over 25 minutes to build.
Thank you for understanding.
Reply to this email directly or view it on GitHub: https://github.com/jdutil/contact_us/issues/7
Are you unable to write files to the system anymore? I think the error may be from testing that my install generator creates the proper files.
You can download our VM images and try running things there. From what I see your rake tasks tests hang, possibly waiting for some input or something like that. Please disable your hook in the mean time, if you join #travis on freenode we probalby can give you access to one of the VMs to run it manually and see for yourself.
You are allowed to write files, you even have passwordless sudo. Please check where you are writing though, we migrated to Ubuntu 11.04 recently and maybe some default permissions have changed.
Here is a list of file descriptors open by your test suite after it hangs:
vagrant@natty32:~$ sudo lsof -p 2578
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
rbx 2578 vagrant cwd DIR 252,0 4096 136227 /home/vagrant/builds/jdutil/contact_us
rbx 2578 vagrant rtd DIR 252,0 4096 2 /
rbx 2578 vagrant txt REG 252,0 71203745 27263 /home/vagrant/.rvm/rubies/rbx-head/bin/rbx
rbx 2578 vagrant mem REG 252,0 103073 418087 /home/vagrant/.rvm/rubies/rbx-head/lib/digest/ext/digest.so
rbx 2578 vagrant mem REG 252,0 180286 418093 /home/vagrant/.rvm/rubies/rbx-head/lib/digest/ext/sha2/sha2.so
rbx 2578 vagrant mem REG 252,0 247782 418091 /home/vagrant/.rvm/rubies/rbx-head/lib/digest/ext/sha1/sha1.so
rbx 2578 vagrant mem REG 252,0 469244 301737 /home/vagrant/.rvm/gems/rbx-head/gems/sqlite3-1.3.4/lib/sqlite3/sqlite3_native.so
rbx 2578 vagrant mem REG 252,0 117960 85 /lib/i386-linux-gnu/ld-2.13.so
rbx 2578 vagrant mem REG 252,0 79476 424 /lib/i386-linux-gnu/libz.so.1.2.3.4
rbx 2578 vagrant mem REG 252,0 1117647 418084 /home/vagrant/.rvm/rubies/rbx-head/lib/18/syck/ext/syck.so
rbx 2578 vagrant mem REG 252,0 294696 167 /lib/libssl.so.0.9.8
rbx 2578 vagrant mem REG 252,0 204624 157805 /home/vagrant/.rvm/rubies/rbx-head/lib/18/bigdecimal/ext/bigdecimal.so
rbx 2578 vagrant mem REG 252,0 189560 299662 /home/vagrant/.rvm/gems/rbx-head/gems/json-1.6.3/ext/json/ext/json/ext/generator.so
rbx 2578 vagrant mem REG 252,0 13564 5347 /lib/i386-linux-gnu/libgpg-error.so.0.8.0
rbx 2578 vagrant mem REG 252,0 9736 82 /lib/i386-linux-gnu/libdl-2.13.so
rbx 2578 vagrant mem REG 252,0 30684 67 /lib/i386-linux-gnu/librt-2.13.so
rbx 2578 vagrant mem REG 252,0 1434180 65 /lib/i386-linux-gnu/libc-2.13.so
rbx 2578 vagrant mem REG 252,0 561528 265877 /usr/lib/i386-linux-gnu/libsqlite3.so.0.8.6
rbx 2578 vagrant mem REG 252,0 71416 290260 /usr/lib/libexslt.so.0.8.15
rbx 2578 vagrant mem REG 252,0 17060675 27230 /home/vagrant/.rvm/rubies/rbx-head/lib/openssl/ext/openssl.so
rbx 2578 vagrant mem REG 252,0 3311244 298689 /home/vagrant/.rvm/gems/rbx-head/gems/nokogiri-1.5.0/lib/nokogiri/nokogiri.so
rbx 2578 vagrant mem REG 252,0 471064 5349 /lib/i386-linux-gnu/libgcrypt.so.11.6.0
rbx 2578 vagrant mem REG 252,0 930044 265548 /usr/lib/i386-linux-gnu/libstdc++.so.6.0.14
rbx 2578 vagrant mem REG 252,0 149392 84 /lib/i386-linux-gnu/libm-2.13.so
rbx 2578 vagrant mem REG 252,0 219392 290261 /usr/lib/libxslt.so.1.1.26
rbx 2578 vagrant mem REG 252,0 121644 80 /lib/i386-linux-gnu/libpthread-2.13.so
rbx 2578 vagrant mem REG 252,0 108040 69 /lib/i386-linux-gnu/libgcc_s.so.1
rbx 2578 vagrant mem REG 252,0 34264 77 /lib/i386-linux-gnu/libcrypt-2.13.so
rbx 2578 vagrant mem REG 252,0 130758 299655 /home/vagrant/.rvm/gems/rbx-head/gems/json-1.6.3/ext/json/ext/json/ext/parser.so
rbx 2578 vagrant mem REG 252,0 176591 418089 /home/vagrant/.rvm/rubies/rbx-head/lib/digest/ext/md5/md5.so
rbx 2578 vagrant mem REG 252,0 1212948 261533 /usr/lib/libxml2.so.2.7.8
rbx 2578 vagrant mem REG 252,0 1341364 168 /lib/libcrypto.so.0.9.8
rbx 2578 vagrant mem REG 252,0 2115719 157800 /home/vagrant/.rvm/rubies/rbx-head/lib/ext/melbourne/rbx/melbourne20.so
rbx 2578 vagrant 0u CHR 136,0 0t0 3 /dev/pts/0
rbx 2578 vagrant 1w CHR 1,3 0t0 4369 /dev/null
rbx 2578 vagrant 2u CHR 136,0 0t0 3 /dev/pts/0
rbx 2578 vagrant 3r FIFO 0,8 0t0 10651 pipe
rbx 2578 vagrant 4w FIFO 0,8 0t0 10651 pipe
rbx 2578 vagrant 5r CHR 1,3 0t0 4369 /dev/null
rbx 2578 vagrant 6w CHR 1,3 0t0 4369 /dev/null
rbx 2578 vagrant 7w REG 252,0 330 145384 /home/vagrant/builds/jdutil/contact_us/spec/dummy/log/test.log
rbx 2578 vagrant 8u CHR 136,0 0t0 3 /dev/pts/0
rbx 2578 vagrant 9w CHR 1,3 0t0 4369 /dev/null
By the way, while this project reveals one improvement we need to make to our infrastructure (we need to make timeouts configurable per project and kill -9 builds that run longer), I seriously doubt this can be considered a travis bug since 3000+ other test suites on travis do not hang up.
Please let me know when you disable the hook and if you are interested in investigating what the issue may be. If you don't want to bother and would prefer to not use travis instead, that's up to you, but we can help.
Its disabled, and I'll be taking a look into it when I get a chance. Love what you guys are doing with travis.
I've discovered the issue. I had been silencing the output stream of the install task, which prevented the error from displaying... Now that there were new translations added the install task would hang waiting for user input on whether to overwrite the new locale files I didn't ensure weren't part of the dummy app.
When the new translations were added I simply merged them in and thought something was going wrong with travis builds not my test suite since I didn't merge in and test locally first...
I'm going to turn the hook back on now.
Thank you for the cooperation!
Maybe this is one of the earlier builds but we are seeing it again
Yeah the fix was build 29. If you could manually kill any builds before that still running that would be great.
Your test suite hangs on travis-ci.org (see for example). We have to ask you either to fix this issue or disable travis-ci hook (Admin => Service Hooks) because every push to your project locks up 6 workers for 30 minutes (our current build timeout value). We cannot lower build timeout at this point because projects like Diaspora take over 25 minutes to build.
Thank you for understanding.