Status monitoring and reporting

[peer35]

• Free/Used space
• Server status
• Usage per project
• I think you are monitoring internally, is there a way we can have insight as well?

[peer35]

Is now on the Surf Roadmap as shown 2020/06/22.

[peer35]

Apparently Claudio from SURF will give a demonstration of a monitoring portal in the coming weeks.

[peer35]

My reaction on Claudio's demo (January 13): https://yodasurf.slack.com/archives/C014N5MFZLH/p1610546723000900

Hi @Claudio Cacciari, Thanks for the link to the Dashboard. The basic idea is sound, Grafana will make it possible to configure this for our needs. I'll put my thoughts here on Slack so others can join the discussion. With regards to setting up dashboards for datamanagers. Do you envision you will set this up on your side or is this something an admin can do at the VU? For a datamanager you would need to setup a view per Yoda category as this is the level where the datamanager role is defined. Do you have this information in your data? I think it is defined in the irods metadata of the collection. We would really like it if we could open up a dashboard like this for end users. E.g. have datamanagers monitor their departments, an overview dashboard with basic information for management, etc. I can imagine there would be lots of different requirements for custom reports, so the ability to set up our own dashboards would be fantastic. For our local Yoda setup we access the iRODS database directly to create custom reports for billing the the research groups. That is not a good idea for this hosted setup, but if we have direct access to the Elastic Search index we could use that data for reporting, together wirh info we can get via iRODS. A first attempt at a list of requirements: Nice-to-have:

• Pre-configured dashboard per Yoda category. Really nice-to-have:
• Ability to configure our own custom dashboards.
• Direct access to the dashboard data for admins so we can create stuff like our own custom reports (for example for financial matters). Required:
• Clear list of storage per Yoda group. These are the top level collection "research-" and "vault-".
• Drill-down per collection. As a datamanager you would like to see which folders are growing when you are concerned about the size of a specific project.
• Only show "top-level" (no filenames) stats for groups with data classification "Sensitive" or "Critical".
• Only give users (datamanagers and group members) access to view information on groups they have access to in Yoda.