search

golang / gddo

Go Doc Dot Org
https://godoc.org
BSD 3-Clause "New" or "Revised" License
1.1k stars 266 forks source link

Packages disappeared from godoc.org #561

Closed keks closed 6 years ago

keks commented 6 years ago

Hi, all packages under the domain go.cryptoscope.co vanished from godoc.org. They used to be there and are still returned in the search results, but the API documentation doesn't show. ge getting to a fresh gopath works fine, and the html for e.g. https://go.cryptoscope.co/margaret/offset?go-get=1 looks correct:

<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>
<meta name="go-import" content="go.cryptoscope.co/margaret git https://github.com/cryptoscope/margaret">
</head>
</html>

I asked in #go-nuts and others agreed this is most likely a bug in godoc.

keks commented 6 years ago

I'd be happy to help out with more info!

also cc @cryptix

shantuo commented 6 years ago

Hi,

The host is blocked since there were tens of thousands of spam subdirectories added to the crawler queue. Those packages look like "go.cryptoscope.co/sbot/info/refs/message/repo/blobstore/blobstore/cmd/cmd/blobstore/repo/blobstore/message/blobstore", which clearly doesn't exist. I need to investigate more on the cause.

By looking at the go-get link I don't think there is anything wrong, I unblock it and will keep an eye on what happens.