why is it checking sha on torrent files, while performing the Home search ! - Githubissues

internetarchive / dweb-mirror

Offline Internet Archive project

https://www-dweb-mirror.dev.archive.org/

GNU Affero General Public License v3.0

263 stars 27 forks source link

why is it checking sha on torrent files, while performing the Home search ! #269

Closed mitra42 closed 4 years ago

mitra42 commented 4 years ago

http://localhost:4244/arc/archive.org/metadata/home Checks sha at approx lone 349 of MirrorFS.checkWhereValidFile See #266 (reload/NOCACHE) & #257 (Search slow to respond)

mitra42 commented 4 years ago

/arc/archive.org/metadata/home
MFS.cacheAndOrStream. folkscanomy/folkscanomy_archive.torrent
MFS.checkWhereValidFile(
cb6 -> because passed digest
MFS.streamhash

Strangely then stops doing digest, maybe because recorded successfully on metadata.

localhost:4244/arc/archive.org/metadata/home (type URL into firefox) note NOCACHE undefined and no cache-busting headings were sent.

[ ] Why are we calling to stream it ?
AF.isDownloaded flag not set
AF.cacheAndOrStream
cacheAndOrStream(opensource_audio/communityaudio.jpg)

It looks like its behaving ok now that its deleting bad torrent files, it only checks each file once and writes the flag in files.json