I made a tiny improvement on service_streamer to make WORKER_TIMEOUT configurable. In some applications such as machine translation, prediction time can exceed WORKER_TIMEOUT. This solves the problem by making WORKER_TIMEOUT configurable for users when Streamer is created.
Sorry for dirty commits - please squash them when merging.
Hi guys,
I made a tiny improvement on service_streamer to make WORKER_TIMEOUT configurable. In some applications such as machine translation, prediction time can exceed WORKER_TIMEOUT. This solves the problem by making WORKER_TIMEOUT configurable for users when Streamer is created.
Sorry for dirty commits - please squash them when merging.