search

Simon-Harris-IBM / ChallengeWorkflowTemplatesSimon

0 stars 1 forks source link

Improve backend queue selection #5

Open Simon-Harris-IBM opened 4 years ago

Simon-Harris-IBM commented 4 years ago

Backend queue selection is done via a random selection of the available (hardcoded) queues. This should be improved before the challenge starts to:

  1. round-robin between hard-coded or dynamic selection of queues
  2. resource based queue selection based on length of queue at time of submission
thomasyu888 commented 4 years ago

@Simon-Harris-IBM. I can attempt to come up with a solution. I have something in mind.

Is the idea that submissions are sent to a queue with the least RECEIVED submissions? There is a query we can do to list out these type of submissions and do a count. Since only one submissions can run on one machine at a time we don't need to query for the EVALUATION_IN_PROGRESS submissions