search

telefonicaid / fiware-cygnus

A connector in charge of persisting context data sources into other third-party databases and storage systems, creating a historical view of the context
https://fiware-cygnus.rtfd.io/
GNU Affero General Public License v3.0
65 stars 105 forks source link

STH Aggregator does not support more than one event #2303

Open ctc-watanabe opened 11 months ago

ctc-watanabe commented 11 months ago

Hi, the following comments and code indicate that the STH Aggregator does not support more than one event and persists events one at a time. https://github.com/telefonicaid/fiware-cygnus/blob/11e4b8524875c0efd3fb3f88a2657cd83f49ecc8/cygnus-ngsi/src/main/java/com/telefonica/iot/cygnus/sinks/NGSISTHSink.java#L99-L107

However, when there are many notifications from Orion to Cygnus and many updated attributes (tens to hundreds of rps), STHSink cannot keep up and the Channel fills up over time.

We would like the STH Aggregator to support multiple events (e.g., update events in a batch at once), but please let us know if this is in your future plans.

Thank you in advance.

ctc-watanabe commented 11 months ago

According to #571, is it difficult to implement?

AlvaroVega commented 11 months ago

@ctc-watanabe I'm afraid there is nothing about STH aggregator in new cygnus roadmap: https://github.com/telefonicaid/fiware-cygnus/pull/2292 Anyway any contribution is welcome. Depending on your experience with cygnus source code could could be not so difficult to implement.