Performance Improvements

sreedevk / deduplicator

Filter, Sort & Delete Duplicate Files Recursively

MIT License

264 stars 15 forks source link

Closed sreedevk closed 1 year ago

sreedevk commented 1 year ago

Changelog:

Added Incremental hashing for files > 100MB
Added MMap file read for files > 100 MB
First checks for duplicates by File size & then the duplicate found are processed through hashing
Remove SQLite & Caching options
Removed Unneeded Cargo dependencies
output print performance improvements