search

flatironinstitute / neuropixels-data-sep-2020

Example neuropixels datasets for purposes of developing spike sorting algorithms
Apache License 2.0
9 stars 6 forks source link

Clean the kachery folder #27

Open yger opened 4 years ago

yger commented 4 years ago

Is there a way to delete the cache for a specific file in the kachery folder? I mean, this folder is getting bigger and bigger after each download, and instead of deleting everything, is there a way to specifically remove some cached files, but not necessarily all of them?

magland commented 4 years ago

Automatic garbage collection is something we haven't yet tackled (but it's in the plan). Here's one thing you could do... delete every file with size >1GB. The chunks will still be in the cache. That should reduce the space used by about 50%.

Just be very careful with this command!

cd $KACHERY_STORAGE_DIR

# do a dry run first to see which files will be deleted
find -type f -size +1000M

Now once you are sure, add the -delete flag to the previous command. (Making sure you are still in the correct directory!)