Following bad links - Githubissues

alexander-bauer / distru

Distributed search for Hyperboria, powered by Go

13 stars 3 forks source link

Following bad links #58

Closed alexander-bauer closed 11 years ago

alexander-bauer commented 12 years ago

Internal links should be analyzed to some degree to prevent the extra load of following links to, for example, images. Distru doesn't have the capability to index images, and they should therefore be avoided. Additionally, this causes problems with javascript links.

alexander-bauer commented 11 years ago

This probably should've been closed by e4aa6284d046179c8c4e2de9d8a6db7d4819df04.