search

idlab-discover / obelisk

Obelisk is a service platform for building scalable data-driven applications and services, connecting data producers and consumers with powerful APIs for ingesting, querying and streaming large amounts of data in an organized and secure way.
https://obelisk.ilabt.imec.be/docs/
Apache License 2.0
6 stars 0 forks source link

Introduce Redis abstractions for an in-memory datastore #23

Open wkerckho opened 2 years ago

wkerckho commented 2 years ago

Similar to #22, services use the Redis API directly, as opposed to interactions with other dependencies such as MongoDB, Clickhouse and Gubernator, which are encapsulated in generic interfaces. We can improve the quality of the codebase, by introducing an abstraction layer for the functionality that is currently provided by Redis directly. From what I see now, this is mostly restricted to various flavors of inter-process shared data structures. For example: a key-value store with TTLs for representing expiring team or data set invitations, or a set of active streaming sessions, etc.

Ideally, this abstraction layer should also be usable as a scalable cache layer for the NGSI-LD implementatin.

wkerckho commented 2 years ago

Note that in essence, Redisson, the library we are using, is an abstraction on top of Redis. Maybe we can also achieve what we need by having some pre-configured Obelisk data structures (built upon Redisson) made available via CDI?

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.