Spark containers don't seem to get pushed to quay

BD2KGenomics / cgl-docker-lib

21 stars 20 forks source link

Spark containers don't seem to get pushed to quay #199

Closed fnothaft closed 7 years ago

fnothaft commented 7 years ago

Reported by @almussel on scrum. The Jenkins ToT build should push the Spark containers.

fnothaft commented 7 years ago

There's a variety of things going on here. Here's a few things we should fix:

[ ] jenkins.py assumes that all tools are tagged with a specific git revision
[ ] jenkins.py logging is a mess (hard to track where log messages are coming from, important things aren't logged)
[ ] lots of builds are just flat out failing

This is going to take a bit to work through, but I've got a sense for things. I'll triage certain bits out to other tickets as I work through them.

fnothaft commented 7 years ago

OK! I think I see now why the Spark containers aren't pushing. Their tags weren't updating when the apache-spark-common container got updated. I've added a commit 15ea9beeed374c5702168425ff590752f96b193a to #200 to fix this.