search

hubotio / hubot-redis-brain

A hubot script to persist hubot's brain using redis
69 stars 55 forks source link

Too much user data #37

Closed timothyeburke closed 4 years ago

timothyeburke commented 4 years ago

Looking for recommendations:

My work's slack workspace has over 7000 users. As the bot runs for a while, it caches all of those users in the brain, which gets written to and read from Redis. The JSON blob gets up over 10MB, which isn't a lot, but moving that back and forth so much between the bot process and Redis starts taking a lot of time, causing the bot to be sluggish. Is there a way to disable caching the user info in Redis? My current solution is to wipe the brain user cache ever 15 min, but it feels hacky.

daniel-beard commented 4 years ago

+1 I am also seeing this issue

timothyeburke commented 4 years ago

I just ended up rewriting Hubot and Redis Brain in Golang, and sidestepped this problem by excluding the user data from the brain.

daniel-beard commented 4 years ago

@timothyeburke why'd you close this ticket? It's still valid for this project.