Open steboi opened 1 month ago
Update the robots.txt file to allow crawling of the web interface. Change the disallow directive to allow
disallow
allow
More info on the topic can be found here: https://developers.google.com/search/docs/crawling-indexing/robots/intro https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt
Update the robots.txt file to allow crawling of the web interface. Change the
disallow
directive toallow
More info on the topic can be found here: https://developers.google.com/search/docs/crawling-indexing/robots/intro https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt