search

It4innovations / hyperqueue

Scheduler for sub-node tasks for HPC systems with batch scheduling
https://it4innovations.github.io/hyperqueue
MIT License
272 stars 21 forks source link

Optimize data (de)serialization in output streaming #727

Closed Kobzol closed 1 month ago

Kobzol commented 1 month ago

The bytes were (de)serialized one by one, instead as a byte array. 15% perf. boost with 10k tasks and 100 KiB output per task streamed.