raviqqe / muffet

Fast website link checker in Go
MIT License
2.51k stars 97 forks source link

same target URL is cache miss if recurs on many pages #267

Closed qrkourier closed 1 year ago

qrkourier commented 1 year ago

What a helpful tool. Thank you!

I expected recurrences of the same target URL to be cache hits, but I get a separate error for each because it appears muffet will check the same link many times if it appears on multiple pages.

raviqqe commented 1 year ago

As described in #34 and #38, they are actually cached although Muffet's output is agnostic about it!