datatogether / sentry

Parallelized web crawler written in Golang
GNU Affero General Public License v3.0
14 stars 6 forks source link

Redis-Backed que #3

Open b5 opened 7 years ago

b5 commented 7 years ago

Should switch que storage to a global state manager (like Redis). As it stands running more than one instance of Sentry connected to the same database will cause overlapping requests.