search

KyleBenson / scale_client

The Python-based SCALE Client software for acquiring data from various sensors (i.e. via Raspberry Pi platform), processing it, and sharing it through multiple networks and data exchange protocols.
http://scale.ics.uci.edu/
Other
4 stars 8 forks source link

Real-time QoS guarantees for event reporting #6

Open KyleBenson opened 10 years ago

KyleBenson commented 10 years ago

We need to implement some form of real-time QoS guarantees in the EventReporter. That is, if enough events are generated within the system, we need to pick only the highest priority ones to send such that we don't create an infinite backlog of unreported events. This is especially important for the Sigfox publisher, whose ultra-low bandwidth capabilities mean that we likely won't be able to report every single event generated but should only report higher-priority events (we should also guarantee that we don't create DUPLICATE EVENTS when they are also reported via MQTT).

We can still store the unreported messages in local storage and send them again later when there are fewer events being generated and/or we have more bandwidth available, but let's save that for a future enhancement and just get the initial real-time system working for now.

KyleBenson commented 7 years ago

We implemented an initial version of this that basically finds the first EventSink (in the order they were added) that's available and sends it. Could alternatively have a configurable policy such as: all, all-highest, highest, first-available

Where highest/first are some notion of priority.

Furthermore, EventReporter could be cleaned up as it has a bunch of poorly documented hacks in it currently.