expose more meta-info for forms/databases (like # of total records in a form/db)

[Ryo-N7]

EDIT: upon discussion with Alex + Nic, this will be more of a focus in January esp. as this is something ActivityInfo needs to do on their back-end of the API rather than any implementation on the R side of things (at least until the data is exposed to the API)

[akbertram]

Expose form metadata for account-level users:

• List of forms - database tree
• For each form:
  • Number of records (MUST HAVE)
  • Last update time (MUST HAVE)
  • Number of users who have access to this form
  • Sensitivity classification of data
  • Visibility

[nickdickinson]

A workaround I found for now while implementing the lazy df is to request one row containing only the record id. This gives the total number of records. If we sort it by update time, then we could in theory get the last updated time too. I've exposed the totalRows metadata in queryTable as well as a few more things as part of the implementation of getRecords() (sorting, limiting, offset).

[Ryo-N7]

is there also any way to download the form-schema of every form in a database without having to loop over each form?

as currently for the +20 projects AV has, this process can take over 10 minutes to just grab all that meta-data before we even get to the processing + visualization bits of the code

[nickdickinson]

I think this is more for @akbertram but as I do not know if this is possible server side.

@Ryo-N7 perhaps it would be an idea to split this over a few different R instances with the foreach package? I've successfully done this for longer GIS processing workflows. I don't know if there are certain rate limits or other considerations (like exponential back offs) that would need to be implemented.