To ensure that Syndi is not blocked by our robot filters, it is using a browser pattern for the User-Agent. This makes for confusing log messages in the accessed services. Since we do blacklisting and not whitelisting for robots, we will modify the Syndi User-Agent to specify that the requests are from Syndi.
To ensure that Syndi is not blocked by our robot filters, it is using a browser pattern for the User-Agent. This makes for confusing log messages in the accessed services. Since we do blacklisting and not whitelisting for robots, we will modify the Syndi User-Agent to specify that the requests are from Syndi.