TORCH-TCN / torch_hub

5 stars 1 forks source link

Organize files transferred to repository based on collection and workflow configuration #62

Open jbest opened 2 years ago

jbest commented 2 years ago

Each collection will have an established organizational standard for files uploaded to each repository. Generally the main standard is for archival files (such as DNG) to be stored in one location/path and the web files (JPG) in another. Specifically, each of these archival and web locations have standards for how the files are organized and sorted within their respective paths. Files are sorted into sub-directories to keep the number of files per directory to a minimum to facilitate listing and management of files.

Files uploaded or transferred from the Hub will either be immediately written to the appropriate location or will be uploaded to a staging area then moved to the correct location (depending on decisions made in system implementation). The final storage path of each file must be known to determine the URL mapping file generated in feature #32

The sorting process is part of the transfer/upload feature #3

jbest commented 2 years ago

This sorting function is implemented in https://github.com/jbest/powersorter