Create a remote upload interface

We want to enable uploads from remote sources. Currently uploading is done with the aid of an admin user but that is a bottleneck.

There are lots of issues attached to this concept, the main being how do we prevent abuse?

[ ] Add a (admin only) configuration switch to projects that allows remote uploads
[ ] Add an admin rest endpoint for managing open sftpgo user accounts (important for stopping abuse behaviors when necessary)
- [ ] List current users
- [ ] Delete/disable a user
[ ] Add a endpoint that is triggered by sftpgo whenever a file is uploaded
- [ ] See actions option for sftpgo configuration https://github.com/drakkan/sftpgo/blob/main/docs/full-configuration.md#configuration-file https://github.com/drakkan/sftpgo/blob/main/docs/custom-actions.md
- This hook should enqueue a harvest item as a file is uploaded
[ ] We'll need a /harvesters endpoint and /harvester/{id}/items endpoint
- Each sftpgo user will represent the harvesting of a single site
- POST /havesters will create a new sftpgo user
  - user id (inferred)
  - site id
  - fallback utc offset
- POST/GET /harvesters will return upload auth details, and notification of expiry timers
- POST /harvesters/enqueue will accept the sftpgo json payload and create a new HarvestItem and enqueue the harvest job
- harvest_items should gain a harvester_id field
- GET /harvesters/{id}/items will list associated harvest items and their status

Other considerations:

Basic workflow:

remote upload enabled for project
POST /security/new to login
POST /sites/{id}/harvest to create upload endpoint (user specific)
return body details upload information
user uploads files via SFTP/WEBDAV
each file triggers a harvest item enqueue
- no harvest.yml is needed because all the critical information is tied to the context of the harvester/sftpgo user
users can get the status of harvests from GET /harvesters/{id}/items

QutEcoacoustics / baw-server