Send platform usage statistics to users

[mzueva]

Background It would be useful to send to users a letter on scheduled basis with insights on the platform usage.

Approach Let's create a python script which generates letters with user's stats for the specified period. Script arguments: from (date), to (date), list of users (reports shall be generated for all specified users), list of roles (reports shall be generated for all users belonging to groups). Lists of users and roles may be specified simultaneously.

Report shall include the following data:

Overall:

• Compute hours (overall): hours
• Runs count: count
• Storage usage
  • Read requests: count
  • Write requests: count
• Usage weight: %% (user costs / platform costs for the same period)
• Login time: hours

Most-used:

• Compute type
  • CPU: hours
  • GPU: hours
• Clusters
  • Compute: hours (total time master instances were running)
  • Worker nodes CPU / GPU: count (number of worker nodes started)
• Top 3 instance types: count
• Top 3 pipelines: count
• Top 3 tools: count
• Top 3 used buckets: count
• Top 3 run capabilities: hours (total time of the runs with a specific capability)

[maryvictol]

@mzueva , @okolesn Bug: The report isn't generated for a list of users (separated by a comma or space). Message in the log: No users found to collect and send statistics.

[maryvictol]

@mzueva , @okolesn Bug: Values Storage write requests count: 0. Storage read requests count: 0. are returned in reports for all users.

[maryvictol]

@mzueva , @okolesn Bug: Method POST /pipeline/restapi/user-notification/message gives error {"message":"Failed to evaluate expression 'hasRole('ADMIN') OR @notificationPermissionManager.hasPermission(#notification)'","status":"ERROR"} for non-admin users. As result non-admin user can't close the notification.

[maryvictol]

@mzueva , @okolesn Bug: Method POST /pipeline/restapi/user-notification/message gives error {"message":"Failed to evaluate expression 'hasRole('ADMIN') OR @notificationPermissionManager.hasPermission(#notification)'","status":"ERROR"} for non-admin users. As result non-admin user can't close the notification.

Verified as fixed