Closed bfineran closed 10 months ago
This PR adds a helper class for executing EngineOperators using batches popped from ContinuousBatchingQueues.
EngineOperators
ContinuousBatchingQueues
The idea is that this thread can run indefinitely, waiting for a new batch from the ContinuousBatchingQueues and running them as available.
The ContinuousBatchingScheduler will spin up num_workers of these threads and run them indefinitely
ContinuousBatchingScheduler
num_workers
test_plan: unit test included
This PR adds a helper class for executing
EngineOperatorsusing batches popped fromContinuousBatchingQueues.The idea is that this thread can run indefinitely, waiting for a new batch from the
ContinuousBatchingQueuesand running them as available.The
ContinuousBatchingSchedulerwill spin upnum_workersof these threads and run them indefinitelytest_plan: unit test included