search

jfilter / split-folders

🗂 Split folders with files (i.e. images) into training, validation and test (dataset) folders
MIT License
412 stars 72 forks source link

added option to symlink (`ln -s`) #48

Open cs-mshah opened 1 year ago

cs-mshah commented 1 year ago

This solves #31. The advantage of having symlinks (ln -s) is that we can just reference the dataset stored at some other place and create a folder structure at any/multiple desired locations as required by some codebases. Deleting symlinks doesn't delete the original dataset.

The changes have been made to support backward compatibility of move=True and move=False along with the addition of move='symlink'. All tests have successfully passed.

a1302z commented 1 year ago

This works wonderfully. Instead of cloning the entire dataset now, I just have links to the original image, which saves so much time and memory. I am very much in favor of merging this into the package.

catevita commented 9 months ago

hi, this option would be amazing, will it be integrated?