implement storage of gNMI data, ideally using real-time storage

srieger1 / digsinet

multiple twins (siblings) of a network topology (e.g., based on containerlab) with continuous data exchange

https://srieger1.github.io/digsinet/

5 stars 0 forks source link

implement storage of gNMI data, ideally using real-time storage #3

Closed srieger1 closed 1 month ago

srieger1 commented 4 months ago

@Sirulex: @Lachstec is currently working on improvements for the queues. If we move to real-time stream processing or queues, these might possibly also offer persistence and storage. Model state and events would than be consistently stored and processed in the queues or data streaming solution. Side note: this is also discussed as an open topic in the IRTF NMRG for Network Digital Twins. Maybe we should keep an eye on that.

Lachstec commented 4 months ago

I am currently looking at some vendors offering Real Time stream processing of events. The candidates are:

RabbitMQ
Celery
Apache Kafka

Results and interesting things will be tracked in this issue.

srieger1 commented 4 months ago

As @Lachstec is currently looking at RabbitMQ we opened a new issue #16

Lachstec commented 1 month ago

Being worked on in #19