Ocypod is a Redis-backed service for orchestrating background jobs. Clients/workers can be written in any language, using HTTP/JSON to queue/fetch jobs, store results, etc.
Apache License 2.0
194
stars
14
forks
source link
Add compression support for input/output fields #34
Looking into adding support for transparently compressing job input and output fields. Possibly a single algorithm to start, with more options later (e.g. zstd/brotli/gz etc.).
Should probably be similar to the way job settings are handled, i.e. where settings can be set at the queue level, or overridden per job.
Should also support separate configuration for input and output, since one/both/neither of these might benefit from compression depending on the workload type.
Looking into adding support for transparently compressing job input and output fields. Possibly a single algorithm to start, with more options later (e.g. zstd/brotli/gz etc.).
Should probably be similar to the way job settings are handled, i.e. where settings can be set at the queue level, or overridden per job.
Should also support separate configuration for input and output, since one/both/neither of these might benefit from compression depending on the workload type.