search

uccross / skyhookdm-ceph-cls

Skyhook Data Management: Storage and management of tabular data in Ceph.
https://www.skyhookdm.com
GNU Lesser General Public License v2.1
13 stars 9 forks source link

Add logging to compile steps. #46

Closed jlefevre closed 4 years ago

jlefevre commented 4 years ago

This was sometimes failing due to repo issues: 

The command '/bin/sh -c yum install -y https://apache.bintray.com/arrow/centos/7/apache-arrow-release-latest.rpm &&     yum install -y       re2-devel       arrow-devel       parquet-devel &&     yum clean all' returned a non-zero code: 1
ERROR: Step 'build-rook-img' failed ('1') !

So had to add a yum update to this command both in the docker build and docker release files.

ivotron commented 4 years ago

So had to add a yum update to this command both in the docker build and docker release files.

looking at the travis log, it looks like a transient network error. yum install automatically runs yum update when building the container since there's no previously cached package metadata.

jlefevre commented 4 years ago

Yes, it seems a transient error, though it happened 2x last night and earlier today as well. I had restarted the build last night, it failed after waiting ~50 min. Travis overwrites the build logs on restart so it might not be visible. So I added the explicit update step, and maybe just got lucky a few times when testing. It is happening again right now when I build the rook-img locally, so maybe something else going on with the mirrors. Let's see if it continues then revisit.

ivotron commented 4 years ago

yeah, seems to be an issue with the arrow/parquet repos . Maybe there is a better mirror we can use. Or download directly from a URL. Nothing wrong with this PR, it's only explicitly doing yum update instead of implicitly via yum install, so I don't think we need to revert that change.

jlefevre commented 4 years ago

More repo shenanigans - just failed again. We will need to look into this further.

...
http://dl.iad2.fedoraproject.org/pub/epel/7/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: dl.iad2.fedoraproject.org; Unknown error"
The command '/bin/sh -c yum update -y &&     yum install -y https://apache.bintray.com/arrow/centos/7/apache-arrow-release-latest.rpm &&     yum install -y       re2-devel       arrow-devel       parquet-devel &&     yum clean all' returned a non-zero code: 1
ERROR: Step 'build-rook-img' failed ('1') !
The command "popper run" exited with 1.

The job is here, but I'm restarting the build log so may be overwritten. But the raw log is here if that remains, and I saved it.

travis.err.build.51.log

jlefevre commented 4 years ago

created issue #48