Make robots.txt available with locale suffix urls

nuxt-modules / robots

Tame the robots crawling and indexing your Nuxt site.

https://nuxtseo.com/robots

412 stars 30 forks source link

Make robots.txt available with locale suffix urls #39

Closed jonalxh closed 3 years ago

jonalxh commented 3 years ago

Hi, I'm wondering if is it possible to access the robots.txtfile from locale urls like mypage.com/es/robots.txt, I've tried with the common initialization and it is only available from root mypage.com/robots.txt.

Could you tell me how to achieve it?

atinux commented 3 years ago

robots.txt must be on the root-level directory, learn more on https://developers.google.com/search/reference/robots_txt