azimjohn / jprq

join public router. quickly.
https://jprq.io
973 stars 145 forks source link

Unwanted Search Engine Crawling of Subdomains #167

Open hoosnick opened 1 year ago

hoosnick commented 1 year ago

I don't know if this is an issue with jprq, but I'm sure it can cause affliction, as it did for me.

When I create a tunnel, Yandex/Google's Crawler Robots try to index my site from the subdomain with a request to my main page and robot.txt, I don't want it.

image

The descriptions, links, payloads from meta tags of my 2-3 private projects are already on the open web(

image