VEuPathDB / lib-compute-platform

Async compute platform core.
1 stars 0 forks source link

Allow external workers. #16

Closed Foxcapades closed 1 year ago

Foxcapades commented 2 years ago

Presently the compute platform only supports internal threadpools as job queue consumers. The platform should also support submitting jobs to queues that are read by external workers.

Foxcapades commented 1 year ago

This is a requirement for updating multiblast to use the new platform.

Foxcapades commented 1 year ago

This would require abandoning the metrics for queue size and queue wait time. Instead of doing this, perhaps the worker threads could be making the request out to the external system to trigger the jobs?

Foxcapades commented 1 year ago

Not necessary.