-
**Is your feature request related to a problem? Please describe.**
bots on the internet should honor the robots.txt (see [RFC 9309](https://datatracker.ietf.org/doc/rfc9309/)
**Describe the so…
-
The current project lacks essential meta tags that are crucial for search engine optimization (SEO). To improve the visibility and ranking of the website on search engines, we need to add the followin…
-
In anticipation of a major version upgrade to `9.0` , following changes need to be made to the branching strategy:
```[tasklist]
### Initial setup for `9.0`
- [x] branch out an `8.x` branch from `mai…
-
https://github.com/matrix-org/synapse/issues/3242
-
We should encourage search engines to index only the current version documentation, and exclude the specific version docs.
For example:
- allow https://cloudnative-pg.io/documentation/current/
…
-
### Description
Lets make Google happy with a little tune up. Google suggests we allow things like images, css, and javascript assets
![Screen Shot 2022-10-13 at 9 08 53 AM](https://user-images.gith…
-
Robots.txt is useful for a few scenarios:
* It's intended purpose to allow/disallow routes for search engine crawlers
* Disallow entire subdomains when subdomains are used for testing
Right now…
-
We need to respect the website's robots.txt files.
It should stop going through URLs that are denied by the robots.txt rules.
-
Any plans for robots.txt compliance?
-
Hallo Sven!
Hi, I am trying to use your Kinematics Solver with a real youbot (Hydro and MoveIt!). It works, but the Robot overshoots hard. So its impossible to use it.
Here is an example:
I tried jus…