search

visualizingthefuture / examples-repository

Repository for https://visualizingthefuture.github.io/examples-repository
Other
5 stars 2 forks source link

Can't archive the website via archive.org #118

Open amzoss opened 3 years ago

amzoss commented 3 years ago

Original request:

I couldn't find the robots.txt, but anyway I don't know if this is local to my machine, but archiving the github.io website on the wayback machine returns an error.

https://web.archive.org/save/https://github.com/visualizingthefuture/examples-repository

The github.com urls work fine.

archive.is is working fine, which is what leads me to believe it is the robots file.

amzoss commented 3 years ago

I'm not seeing a robots.txt, and I don't have much experience with this process. Did find this, so we can look into this option in the future.

https://ryanfb.github.io/etc/2016/09/09/archiving_jekyll_websites_with_sitemaps.html

amzoss commented 3 years ago

Note: this repo is included in GitHub Archive Program