plugins /plugin-seo can give a options to control generateRobotsTxt robots.txt

[lizhq]

Clear and concise description of the problem

No control over generated content for robots.txt

Suggested solution

If it exists under the public directory, it should not be generated or provide the option to generate content.

Alternative

If it exists under the public directory, it should not be generated

Additional context

plugins/plugin-seo/src/node/generateRobotsTxt.ts no

[Mister-Hope]

Is there any problem with current logic? Why should the plugin provide an option to control the content append? If you want to disallow the search engine to index them, then why you need this plugin? If not, what's the problem of force adding a declaration?

[lizhq]

I think what you said makes sense

[Mister-Hope]

I confirm that multiple declaration with same content works in all search engine, so closing this one. No robot.txt is the same as disallow