Fix/sitemap robots for SEO

[gdjohn4s]

Description

Apivault has dynamic robots/sitemap generation now for better indexing on search engines.

Proposed Changes

The robots config is:

export default [
  { UserAgent: '*' },
  { Disallow: '/' },
  { BlankLine: true },

  { Sitemap: () => 'https://apivault.dev/sitemap.xml' }
]

Additional Information

We are using the simplest config for now, preparing all dynamic routes inside nuxt.config.ts:

  sitemap: {
    siteUrl: 'https://apivault.dev',
    urls: async () => {
      return categoriesProperties.map(category => ({
        loc: `/categories/${category.name}`,
        lastmod: new Date(),
        changefreq: 'daily',
        priority: 0.2,
      }))
    },
    defaults: {
      changefreq: 'daily',
      priority: 0.5,
      lastmod: new Date()
    }
  },

We should change this using modules in the future, when apivault will become bigger.

Checklist

• [x] My submission is formatted according to the guidelines in the contributing guide
• [x] My addition is ordered alphabetically
• [x] My submission has a useful description
• [x] Code follows the established CODE_OF_CONDUCT guidelines.
• [x] Code has been tested thoroughly and passes all tests.
• [x] All commit messages are descriptive and follow the established commit message format.
• [x] Pull request title follows the established pull request title format.
• [x] Pull request description clearly describes the changes included in the pull request.
• [x] The description does not have more than 100 characters
• [x] Each table column is padded with one space on either side
• [x] I have searched the repository for any relevant issues or pull requests
• [x] Any category I am creating has the minimum requirement of 3 items