ngageoint / scale

Processing framework for containerized algorithms
http://ngageoint.github.io/scale/
Apache License 2.0
105 stars 45 forks source link

Recipe Instance Job Statuses Inconsistencies #1847

Open emimaesmith opened 4 years ago

emimaesmith commented 4 years ago

Description There is a discrepancy between the jobs status reported in the details.nodes and the jobs_ count fields returned by the /recipes/{id}/ serializer. There are instances where the the jobs_ counts returned do not match the statuses returned for each node. This causes the UI to color code each node differently than the overall job status bar reports.

This appears to be due to a lag between the messages being sent to update the recipe node status and the message being sent to update the recipe metrics.

Reproduction Steps Steps to reproduce the problem:

  1. Go to Scale -> Processing -> Recipes
  2. Click on a running recipe
  3. Hover over the jobs status bar and note the number of running/pending/queued/canceled/etc
  4. See if those numbers match the color coded nodes in the recipe graph

Expected behavior The color codes of the nodes in the recipe graph should match the reported jobs_ count fields coming back from the /recipes/{id}/ endpoint.