JohnDoee / autotorrent2

Cross-seed matching and torrent lifecycle tool
https://johndoee.github.io/autotorrent2/
MIT License
142 stars 10 forks source link

ignore_files option is missing from config #7

Closed newadventure079 closed 2 years ago

newadventure079 commented 2 years ago

It would be nice to have an option to ignore files and keep with at1 parity

A scan with at1 for my files would take 10 mins. With at2, it takes 60 mins. It might be because ignore_files is missing (I had a lot ignored with at1)

JohnDoee commented 2 years ago

The scan stuff might be slower too.

How long does something like ls -R take ? Does subsequent scans run faster (where most files are already saved to the database).

The OS sometimes caches file listings that might affect any tests and speed might depend on their order.

newadventure079 commented 2 years ago

Subsequent scans are 15 mins faster:

time at2 -v scan Executed in 45.24 mins

ls -R output: time ls -R "/dir1" "/dir2" "/dir3" "/dir4" "/dir5" "/dir6" Executed in 406.76 sec

I made some crude changes in db.py

if '.jpg' in name or '.png' in name or '.gif' in name:
    return

Time after crude image files ignore code: time at2 -v scan Executed in 733.14 secs

JohnDoee commented 2 years ago

Skip file pattern is added in 1.0.3