search

yadayada / acd_cli

An unmaintained command line interface and FUSE filesystem for Amazon (Cloud) Drive
Other
1.35k stars 165 forks source link

Splitting large files into chunks #534

Open manwe-pl opened 7 years ago

manwe-pl commented 7 years ago

Just a wild thought. If files >10GB are problematic, and >50GB are impossible to upload, maybe acd_cli could split them into 8GB chunks? So for example file movie.mkv (30GB) could be sliced into ##part000##movie.mkv up to ##part003##movie.mkv. Of course in fuse those files would be visible as one. Finding the offset and proper part is quite easy. If parts are 8GB in size (8,589,934,592 bytes) and we want for example byte number 10,000,000,000, part number is 10000000000 // 8589934592 = 1, position in that part is 10000000000 % 8589934592 = 1410065408.

I think there are people (including me) that would consider a donation/bounty for such feature :)

odarriba commented 7 years ago

But, theorically, that will make that files difficult to use in computers that doesn't make use of acd_cli for syncing, doesn't it?

I'm noy saying it is a bad idea, but if done, maybe it should be configurable 😄

manwe-pl commented 7 years ago

There's nothing wrong with it being an option.

bgemmill commented 7 years ago

Have a look at duplicity if this is a concern; it may be more straightforward to layer a chunking system over top of acdcli than to build it in.