Process Manager

[SpraxDev]

A critical part on how Apollo is going to operate - A lot of functionality is run outside of Apollo's process.

For that, the Process Manager should expose functionality to queue tasks, give them priorities and resources, etc.

• [ ] Processes can be linked to a user
  • [ ] Users can see their past and running processes
  • [ ] Including their output
• [ ] Processes can be marked as internal and are only shown to admins (Intended for quick, internal tasks like thumbnail extraction)
• [ ] Process output is logged to a file
  • [ ] Automatically deleted after n days
  • [ ] Can be marked as admin-only so users don't get to see the log output
• [ ] Exposes an API to provide a process's progress for others to view/display it
• [ ] Processes can be cancelled by admins/users
  • [ ] Processes can be marked as user-read-only to prevent users from canceling it
• [ ] Processes can be marked as CPU, memory or storage intensive
  • [ ] This should help scheduling/delaying processes to not run too many CPU intensive processes
• [ ] Processes can be provided with an estimate of additionally required peak storage consumption
  • [ ] This could be used by #14
• [ ] Processes can be given a priority
  • e.g. live video transcoding for streaming should be given a higher priority while being configured to not be too resource hungry
  • or functionality required by the frontend