search

LegenJCdary / ingeSTation

Python application designed for data ingest(at)ion and controlling operations on ingest stations. ST stands for Speedy Transfer or Super Turbo.
MIT License
1 stars 0 forks source link

DataPartitioning #7

Open LegenJCdary opened 1 year ago

LegenJCdary commented 11 months ago

For large files on HDDs:

LegenJCdary commented 11 months ago

rsync does 4KiB blocks (sectors?) and Lustre uses 1 MiB, so this could be adjusted.