search

TWiStErRob / twisterrob.github.io

Personal website: www.twisterrob.net
https://www.twisterrob.net
Other
9 stars 10 forks source link

Dagger indexing issue #22

Open TWiStErRob opened 1 year ago

TWiStErRob commented 1 year ago

Somehow Dagger URLs are showing up on my page: https://www.google.com/search?q=site%3Atwisterrob.net+dagger

even though I don't have that folder, nor had it for a long long time. It's a potential redirect from twisterrob.github.io/dagger which would be from the www.github.com/twisterrob/dagger repository. But that repo has been deleted long ago (months), and my DNS was set up to redirect a long time ago too (years).

image

image

TWiStErRob commented 1 year ago

Not a clue why this is happening, for now trying to use robots.txt to prevent this. Looking at the search results in Google these two represent the all the potential patterns:

http://www.twisterrob.net/dagger/api/2.13/dagger/android/support/class-use/FragmentKey.html
http://www.twisterrob.net/dagger/api/latest/dagger/grpc/server/class-use/CallScoped.html

So I removed the host and the package folders, and blanket ignored the rest in https://github.com/TWiStErRob/twisterrob.github.io/commit/ed799f934250c0a7f6527c42f02343ef4ceac95c

TWiStErRob commented 1 year ago

If it doesn't help https://search.google.com/search-console/remove-outdated-content might help.

TWiStErRob commented 1 year ago

Submitted a few today about 9 out of 15 results + the /dagger/ prefix.