Motiva-AI / clj-sqs-extended

Client library for AWS SQS with support for large messages, up to 2GB. This is a Clojure wrapper for https://github.com/awslabs/amazon-sqs-java-extended-client-lib
MIT License
3 stars 0 forks source link

messages from SQS takes at least 20 seconds to get processed #106

Closed Quantisan closed 4 years ago

Quantisan commented 4 years ago

this seem to be sort of working with sqs-utils 0.10.0. But it's taking ~20 seconds for a received message to be processed by the handler...

CPU load is < 1% on the worker container, so it's probably not some runaway loop. I'm guessing that we're opening too many client connections and getting throttled by the java client.

Next step, try to share one client instance. I am suspecting this is the client connection throttling that dailybytes mentioned.