For multi-site builds, the body of the robots.txt is only ever loaded for the first site, users have to start from scratch for any site other than the first site.
How To Reproduce
Go to the Robots admin screen for a multi site build.
Edit the Robots.txt content and save it for the first site.
Edit the Robots.txt content and save it for the second site.
Leave the Robots admin screen and reload it.
Note that the content for the Robots.txt is specific to the first site in the dropdown.
Select a different site
Note that the content shown is still for the first site in the list.
This is a specific issue to multi-site builds. This is occurring with version 4.0.0. The specific version of EPiServer this has been encountered on is 11.15.0.
For multi-site builds, the body of the robots.txt is only ever loaded for the first site, users have to start from scratch for any site other than the first site.
How To Reproduce
This is a specific issue to multi-site builds. This is occurring with version 4.0.0. The specific version of EPiServer this has been encountered on is 11.15.0.