is primarily intended for consumption by automated software systems. Such software
systems may be part of search engines, testing frameworks or API using applications.
In keeping with terminology from the robots.txt format they are referred to as robots from here onwards.
It seems that a Terminology section a la a standard IETF I-D would be a good thing. “File” (if still used vs. my suggested term above), “robot”, perhaps “authoritative”, etc. could be defined in it.
is primarily intended for consumption by automated software systems. Such software systems may be part of search engines, testing frameworks or API using applications. In keeping with terminology from the robots.txt format they are referred to as robots from here onwards.
It seems that a Terminology section a la a standard IETF I-D would be a good thing. “File” (if still used vs. my suggested term above), “robot”, perhaps “authoritative”, etc. could be defined in it.