search

Skallwar / suckit

Suck the InTernet
Apache License 2.0
728 stars 40 forks source link

Exclude already downloaded file #200

Open Vaibhav1587 opened 2 years ago

Vaibhav1587 commented 2 years ago

How to use the exclude to check page has been already downloaded and skip it?

Is there a way to check the create timestamp of directory/file ?

Skallwar commented 2 years ago

How to use the exclude to check page has been already downloaded and skip it?

An already visited URL will never be pushed to the download queue. This is built-in standard behavior no need to do anything specific

Is there a way to check the create timestamp of directory/file ?

Not at the moment. If this is something you need feel free to open an issue to discuss it