search

matryer / vice

Go channels at horizontal scale (powered by message queues)
https://medium.com/@matryer/introducing-vice-go-channels-across-many-machines-bcac1147d7e2
Apache License 2.0
1.54k stars 79 forks source link

Updates for SQS writers #49

Closed jsteenb2 closed 6 years ago

jsteenb2 commented 6 years ago

This PR adds the ability to batch publishes to SQS (a necessity for high throughput). This PR also adds the ability to create multi publishers to SQS. The constructor dictates batch-size and number of publishers. The external API doesn't change, however, the throughput with SQS will dramatically improve.

matryer commented 6 years ago 
/home/travis/gopath/src/github.com/matryer/vice/queues/nats/nats_test.go:25:44: 2-valued uuid.NewV4() (value of type (github.com/satori/go.uuid.UUID, error)) where single value is expected
matryer commented 6 years ago

@jsteenb2 thanks for this - it looks like we've been hit for the first time with a dependency issue.

matryer commented 6 years ago

(please pull from master - I fixed that broken test)

jsteenb2 commented 6 years ago

@matryer the branch was rebased off of master with your fixes 👍