BYON jobs stuck for a long time at "Provision Job" Node

Shippable / support

Shippable SaaS customers can report issues and feature requests in this repository

101 stars 28 forks source link

BYON jobs stuck for a long time at "Provision Job" Node #5067

Open vkamra opened 4 years ago

vkamra commented 4 years ago

Description of your issue:

Our jobs that run on BYON node pool are stuck for along time at

Provision job node
  Info
Running job on BYON node pool: default_node_pool

NOTE: If you are experiencing a build failure, please include:

Link to the build failure
Scripts called from the yml (optional)

a-murphy commented 4 years ago

Nothing appears to be stuck at this time. If you see this again, please include either the name of the project or the ID from the bottom of the page so that we are able to look at the correct project.

vkamra commented 4 years ago

I see another one stuck for the last 6 minutes right now:

Project Id: 588bab1f1418801000ac3def Job ID: 37663.1

a-murphy commented 4 years ago

It looks like your subscription is using your own nodes, and some of those nodes appear to be available but aren't running any builds. One ran out of space, and is marked as failed on the node pool page, and I would suggest reinitializing that one and the other nodes that aren't running anything. Directions to reinitialize are here.