The robots.txt file is not handled by The SEO Framework.

sybrew / The-SEO-Framework-Extension-Manager

A WordPress plugin that manages extensions for The SEO Framework.

https://tsf.fyi/em

GNU General Public License v3.0

76 stars 9 forks source link

The robots.txt file is not handled by The SEO Framework. #63

Open yavuzc opened 2 years ago

yavuzc commented 2 years ago

I do not have a robots.txt in my root folder but the extension manager says The robots.txt file is not handled by The SEO Framework. Also whem I go to https://www.destincondorent.com/robots.txt, seems that a file is displayed

sybrew commented 2 years ago

Hello!

The output looks good to me, but Monitor reports outdated information.

Monitor reports back what it found the last time it crawled your website. Request a crawl from Monitor to make sure it parses the latest data. After a couple of minutes, when Monitor is done crawling, hit Fetch Data to retrieve the latest information.

You can see when it last crawled your site in the Control Panel. If you made significant changes after this, it's best to request a crawl.