Open mormj opened 3 years ago
Might not require a separate scheduler, just a tracking and limiting of the "total in-flight" samples
Right now, if all blocks are placed in a single thread, the latency can be managed with set_max_fill, see https://github.com/mormj/ns-bench/blob/main/blocklib/bench/test/test_latency.py
Integrate the functionality from https://www.youtube.com/watch?v=jq0RewceCwc&list=PLE7tQUdRKcyaaF1pm1MfQm_g1TF2CP1JZ&index=35
Or, do it a different way.