kvark / choir

Task Orchestration Framework
MIT License
52 stars 3 forks source link

Dynamically split multi-tasks based on load #6

Closed kvark closed 2 years ago

kvark commented 2 years ago

This makes the load automatically balanced if one of the instances takes significantly more time than the other. It also seamlessly supports changing the worker configuration in-flight.

A benchmark is also added. It shows that the overhead for multi-task is almost twice as large, comparing to individual tasks.