Turns out, state compression can make a big difference. Of course depending on the circumstances (Redis Bandwidth, Latency, State Size, ...). You can run REDIS_URL=redis_host:redis_port pytest benchmarks/benchmark_pickle.py to test it on your machine.
Will probably evaluate other compression algorithms (especially those integrated into python) in a followup and introduce a ReflexCompressor Interface.
Turns out, state compression can make a big difference. Of course depending on the circumstances (Redis Bandwidth, Latency, State Size, ...). You can run
REDIS_URL=redis_host:redis_port pytest benchmarks/benchmark_pickle.py
to test it on your machine.Will probably evaluate other compression algorithms (especially those integrated into python) in a followup and introduce a
ReflexCompressor
Interface.