Closed archseer closed 8 years ago
@chanks any ideas here?
A timeout sounds like a likely culprit. It looks like the default Redis client's timeout is five seconds and can be overridden with an option, e.g. Redis.new timeout: 30
.
Does that fix your issue? If so, we'll probably want to add it to the docs about the lua processing strategy.
Yeah, that seems to have fixed it! Due to the blocking nature, we're probably going to go with union
anyhow. I'll close the issue now.
:+1:
Hi, we're using this gem in combination with hiredis v0.6.0. We've imported about 100k items previously using
add_to_matrix
(no bang), and now we're trying to process the entire dataset. With the lua processor, the code runs, then after a minute or so crashes:Now interestingly, I tried chunking the processing, and it still seems to happen:
Possibly related to some sort of a timeout in the redis client?