Evaluate Grafana and PocketBase data streaming

[defagos]

We aim to enhance our data visualisation capabilities by integrating PocketBase with Elasticsearch and Grafana.

The proposed solution involves setting up an event dispatcher using a Spring Boot application that will consume events from PocketBase, publish these events to Elasticsearch, and allow Grafana to inspect the data.

Additionally, we will evaluate connecting Grafana directly to SQLite and another instance of SQLite replicated by the event dispatcher.

graph TD
  subgraph Clients
    Chrome
    iPhone
    tvOS
    ...
  end

  subgraph I[Data Visualization]
    J[Grafana]
  end

  subgraph L[Rest API]
    M[Pocket Base]
  end

  subgraph A[Event Dispatcher]
    B[Spring Boot Application]
  end

  subgraph G[Data Storage]
    H[Elasticsearch]
    P[Sql lite]
  end

  Clients -->|Emit events| L
  L -->|Consumes event stream|A
  A -->|Publishes events| G
  I ---->|Reads from| G

Evaluate other data visualisation solutions like superset

[defagos]

Some preliminary results:

• A simulator has been implemented with Grafana and Elastic Search.
• SQLite is probably too slow for dashboard with several graphs.