praekeltfoundation / vumi

Messaging engine for the delivery of SMS, Star Menu and chat messages to diverse audiences in emerging markets and beyond.
BSD 3-Clause "New" or "Revised" License
421 stars 131 forks source link

Seemingly overly eager response to SMPP throttling #767

Closed smn closed 10 years ago

smn commented 10 years ago
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:00+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'

... snip ...

2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:abefa65dbcef4bfbbb2fc379135288af'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] 'Could not retrieve throttled message:None'
2014-04-09 15:05:01+0000 [VumiRedis,client] Processed event message for netcore_india_smpp_transport: {"transport_name": "netcore_india_smpp_transport", "event_type": "delivery_report", "event_id": "69005
caf2ac2418fa194bcb60ea4bdf3", "message_type": "event", "helper_metadata": {}, "routing_metadata": {}, "message_version": "20110921", "timestamp": "2014-04-09 15:04:15.842151", "delivery_status": "delivere
d", "transport_metadata": {}, "user_message_id": "6cce9437a702467eb7ac7e777a76ee88"}
2014-04-09 15:05:01+0000 [VumiRedis,client] << {'body': {'mandatory_parameters': {'message_id': ''}}, 'header': {'command_status': 'ESME_ROK', 'command_length': 0, 'sequence_number': 391, 'command_id': 'd
eliver_sm_resp'}}
2014-04-09 15:05:01+0000 [HTTP11ClientProtocol,client] Unhandled error in Deferred:
2014-04-09 15:05:01+0000 [HTTP11ClientProtocol,client] Unhandled Error
        Traceback (most recent call last):
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 423, in errback
            self._startRunCallbacks(fail)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks
            self._runCallbacks()
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 577, in _runCallbacks
            current.result = callback(current.result, *args, **kw)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1155, in gotResult
            _inlineCallbacks(r, g, deferred)
        --- <exception caught here> ---
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
            result = result.throwExceptionIntoGenerator(g)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
            return g.throw(self.type, self.value, self.tb)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/middleware/base.py", line 186, in _handle
            message = yield handler(message, connector_name)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
            result = result.throwExceptionIntoGenerator(g)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
            return g.throw(self.type, self.value, self.tb)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/middleware/message_storing.py", line 94, in handle_event
            yield self.store.add_event(event)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1099, in _inlineCallbacks
            result = g.send(result)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/components/message_store.py", line 236, in add_event
            event_record = self.events(event_id, event=event, message=msg_id)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/model.py", line 687, in __call__
            return self._modelcls(self._manager, key, **data)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/model.py", line 208, in __init__
            descriptor.initialize(self, field_value)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 634, in initialize
            self.set_foreign_object(modelobj, value)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 641, in set_foreign_object
            self.validate(otherobj)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 34, in validate
            self.field.validate(value)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 126, in validate
            raise ValidationError("None is not allowed as a value for non-null"
        vumi.persist.fields.ValidationError: None is not allowed as a value for non-null fields.

... snip ...

2014-04-09 15:05:01+0000 [HTTP11ClientProtocol,client] Unhandled error in Deferred:
2014-04-09 15:05:01+0000 [HTTP11ClientProtocol,client] Unhandled Error
        Traceback (most recent call last):
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 423, in errback
            self._startRunCallbacks(fail)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks
            self._runCallbacks()
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 577, in _runCallbacks
            current.result = callback(current.result, *args, **kw)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1155, in gotResult
            _inlineCallbacks(r, g, deferred)
        --- <exception caught here> ---
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
            result = result.throwExceptionIntoGenerator(g)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
            return g.throw(self.type, self.value, self.tb)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/middleware/base.py", line 186, in _handle
            message = yield handler(message, connector_name)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
            result = result.throwExceptionIntoGenerator(g)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
            return g.throw(self.type, self.value, self.tb)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/middleware/message_storing.py", line 94, in handle_event
            yield self.store.add_event(event)
          File "/var/praekelt/vumi-go/ve/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1099, in _inlineCallbacks
            result = g.send(result)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/components/message_store.py", line 236, in add_event
            event_record = self.events(event_id, event=event, message=msg_id)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/model.py", line 687, in __call__
            return self._modelcls(self._manager, key, **data)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/model.py", line 208, in __init__
            descriptor.initialize(self, field_value)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 634, in initialize
            self.set_foreign_object(modelobj, value)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 641, in set_foreign_object
            self.validate(otherobj)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 34, in validate
            self.field.validate(value)
          File "/var/praekelt/vumi-go/ve/src/vumi/vumi/persist/fields.py", line 126, in validate
            raise ValidationError("None is not allowed as a value for non-null"
        vumi.persist.fields.ValidationError: None is not allowed as a value for non-null fields.
smn commented 10 years ago

This was resolved.