Node-hosted metrics

[olisand]

As an ELIXIR Node, I want to be able to keep metrics data in my own premises

[unode]

This requires a distributed design which was discussed during TMD-Tango hackathon 2023 but was considered too complex to tackle during that period.

Some issues were raised, including implications of GDPR, data ownership and data transfer, that require clarification. Concerns raised and alternatives discussed include:

• How data should (or not) be exchanged between different instances of Tango. Both alternatives require a list of known Tango instances or a protocol for self-discovery. Alternatives:
  • The reporting interface (front-end) directly collecting data from different Tango (back-end) servers
  • Tango servers (back-end) collecting data from each other (without persistence)
• How to resolve/group events organized by multiple nodes - requires a shared unique identifier
• Need for additional access control mechanisms (Node-only or internal/private data vs Public data)
• Node specific customizations - see also #8
• Self-hosting (decoupled or federated) documentation - see also #20

[mihai-sysbio]

For reference, the Data protection in ELIXIR.