krmaxwell / maltrieve

A tool to retrieve malware directly from the source for security researchers.
GNU General Public License v3.0
562 stars 184 forks source link

Question: remember downloaded binaries #147

Closed eldraco closed 9 years ago

eldraco commented 9 years ago

Does it remember the binaries that it already downloaded from the sites so it does not download them again?

krmaxwell commented 9 years ago

It remembers the URLs previously downloaded and the hashes. If the same file exists at a different URL, it won't know that until it downloads it (but when it does it will see we already have the hash). And it doesn't download the same URL twice.

See urls.json and hashes.json for more (although the implementation may change in a future update).