Google search shows lack of crawled metadata

interledger / interledger-website

🙅 Previous version of the interledger.org website

6 stars 10 forks source link

Google search shows lack of crawled metadata #31

Closed mccamon closed 2 years ago

mccamon commented 3 years ago

From incognito when you search "Interledger Foundation" the crawled data is empty. Upon further review it does look like the site hasn't been indexed since 2015.

nathanielfostanperry commented 3 years ago

@mccamon We pushed an update that should resolve this issue. It may take some time for google to crawl the site again however.

mccamon commented 2 years ago

Verified robots.txt file is now working properly.

AlexLakatos commented 2 years ago

The current robots.txt file reverted back and is not allowing any pages on the site to be crawled because it uses Disallow: /.