-
## Required Information
* [ ] AEM Version, including Service Packs, Cumulative Fix Packs, etc: _6.5, 6.5.9______
* [ ] ACS AEM Commons Version: _____4.12
* [ ] Reproducible on Latest? yes/no
…
-
-
Hi @samclarke ,
I have a script to watch multiple `robots.txt` from websites but in some case they have none but still display a fallback content. The issue is your library will tell `isAllowed() -…
-
We are working on improving Google indexing and have noticed that pages in the form /items/*/request-a-copy are indexed in Google. Would it make sense to further enhance robots.txt with the optional s…
-
-
- Tell search engine crawlers which URL can be accessed
Reference: https://developers.google.com/search/docs/advanced/robots/intro
I wonder is this something necessary for this website?
-
Start the following systems for initial release
- Charging Station
- Bionic Quetzal
- Bionic Parasaur
- Bionic Stegosaurus
-
-
Since we have changed the robot we need to update the default robot that they are initially given. It should do some very basic movement and print the output of some of the sensors so that the partici…
-
**Describe the bug**
`robots.txt` file is set to disallow crawling while we're actively developing. Need to fix for production