Survey Reloaded: Revived & enhanced with app statistics and new reporting frontend

[Rello]

Current status

• survery data is only available to the Nextcloud team
• for apps, only the enabled-status + version is being reported

Requirements

• the community is asking for usage data about their apps
• collect metrics about apps
• make data available to app owners

Proposal

• revive the existing survey server app => new instance => performance tuning
• enhance survey_client to transmit app related data
• provide endpoint for app owners to register own app data to be transmitted
  • per app, only numeric values can be provided to avoid and risk of user data transmittance
  • examples for app metrics: version, numberOfBoards, numberOfReports, averateTableSize
• add app-data category to client`s admin settings to allow enable/disable
• usage of the Analytics app for flexible reporting
• data is persisted daily via Analytics automation
• use the sharing feature of Analytics to provide app specific data to owners
• disable existing server data aggregation jobs due to performance issues

Challenges

• [ ] Task (Sysadmin): Existing server on NC13 => move to up-to-date instance
• [ ] Decision: Decide on what data is relevant? currently 6 years of obsolete instances. survey_client is reporting at least once a month. If no update for >6 month, the data is obsolete and can completely be ignored in my opinion. there is no added value in old date. just current working instances should be of interest
• [ ] Evaluation: current data structure only 2 levels: id => category (server, apps, stats) => key => value to be evaluated if apps can become a category
• [ ] Task (Analytics Rello): dynamic way to provide reports to app owners without manual work => via app store?

Implementations

• [x] survey_server compatibility with NC25 - done
• [x] show last update in dashboard done
• [x] automated deletion of old entries; Admin setting for number of years (default 2?); delete data < years done
• [x] admin settings to set deletion threshold
• [x] migration to chart.js v3.9

[Rello]

PoC of Analytics reports based on survey data

App Adaptation

App absolute numbers

NC versions

any parameters

[Rello]

@DaphneMuller

[Rello]

Existing statistics are working again and were migrated to the current chart.js version

[Rello]

https://github.com/nextcloud/survey_server/pull/31

This pull makes the exiting version working again. app-specific reporting needs to come afterwards

[DaphneMuller]

@tobiasKaminsky is there any chance this can be planned?