search

l3uddz / cloudplow

Automatic rclone remote uploader, with support for multiple remote/folder pairings. UnionFS Cleaner functionality: Deletion of UnionFS whiteout files and their corresponding files on rclone remotes. Automatic remote syncer: Sync between different remotes via a Scaleway server instance, that is created and destroyed at every sync.
GNU General Public License v3.0
339 stars 48 forks source link

Transferred and Elapsed Time controls #80

Closed shortbus closed 2 years ago

shortbus commented 4 years ago

Describe the problem Feature: Monitor rclone output for "Transferred" and "Elapsed time"; so that when 750 GB has been transferred (or if a specified time has elapsed) then it will move on the next sequential uploader or sync job option.

Describe any solutions you think might work In the same way that the "rclone sleeps" section works you can monitor for the "Transferred:" and "Elapsed time:" There could be settings in the config.json that call out "transferred-limit" and "elapsed-time-limit". Then during uploads when either "transferred-limit" and "elapsed-time-limit" the cloudplow will stop that uploader or syncer job and move onto the next job.

Additional context This is to allow users to have several remotes configured and avoid hitting data caps for a team drive, for example. Yet still, be able to move on to a different team drive and upload content to the next one.

efanibi25 commented 3 years ago

This isn't really needed as a guide on how to create service accounts would fix this issue.

For now I'd look that up and add those accounts email to the drive